-- Logs begin at Mon 2022-04-11 13:11:08 UTC, end at Mon 2022-04-11 14:13:35 UTC. -- Apr 11 13:46:31.832061 dv-cinder-830787-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 11 13:46:31.840838 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 11 13:46:31.842700 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Apr 11 13:46:31 2022] *** Apr 11 13:46:31.842700 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 11 13:46:31.842700 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 11 13:46:31.842700 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: nodename: dv-cinder-830787-2-iscsi Apr 11 13:46:31.842700 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: machine: x86_64 Apr 11 13:46:31.842700 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: clock source: unix Apr 11 13:46:31.842700 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: pcre jit disabled Apr 11 13:46:31.842700 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: detected number of CPU cores: 4 Apr 11 13:46:31.842700 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: current working directory: / Apr 11 13:46:31.842700 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: detected binary path: /usr/bin/uwsgi-core Apr 11 13:46:31.843393 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: your processes number limit is 47680 Apr 11 13:46:31.843393 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: your memory page size is 4096 bytes Apr 11 13:46:31.843393 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: detected max file descriptor number: 2048 Apr 11 13:46:31.843393 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: lock engine: pthread robust mutexes Apr 11 13:46:31.843393 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: thunder lock: enabled Apr 11 13:46:31.843393 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 11 13:46:31.843393 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 11 13:46:31.887954 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: Python main interpreter initialized at 0x55c1f84799c0 Apr 11 13:46:31.887954 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: python threads support enabled Apr 11 13:46:31.887954 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: your server socket listen backlog is limited to 100 connections Apr 11 13:46:31.887954 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: your mercy for graceful operations on workers is 90 seconds Apr 11 13:46:31.888277 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: mapped 403077 bytes (393 KB) for 2 cores Apr 11 13:46:31.888362 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: *** Operational MODE: preforking *** Apr 11 13:46:31.888604 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: *** uWSGI is running in multiple interpreter mode *** Apr 11 13:46:31.888604 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: spawned uWSGI master process (pid: 102579) Apr 11 13:46:31.888791 dv-cinder-830787-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 11 13:46:31.890718 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: spawned uWSGI worker 1 (pid: 102580, cores: 1) Apr 11 13:46:31.890718 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: spawned uWSGI worker 2 (pid: 102581, cores: 1) Apr 11 13:46:31.890718 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 13:46:33.085125 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 13:46:33.091797 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 13:46:33.940883 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 13:46:33.940883 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: from cryptography.utils import int_from_bytes Apr 11 13:46:33.941221 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 13:46:33.941221 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: from cryptography.utils import int_from_bytes Apr 11 13:46:33.942849 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 13:46:33.942849 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: from cryptography.utils import int_from_bytes Apr 11 13:46:33.943219 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 13:46:33.943219 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: from cryptography.utils import int_from_bytes Apr 11 13:46:36.497467 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 13:46:36.498022 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 13:46:36.498242 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 13:46:36.498607 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 13:46:36.498865 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 13:46:36.499253 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.499578 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.499925 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.500245 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.500406 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 13:46:36.500781 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.500866 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 13:46:36.500943 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.501190 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.501298 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 13:46:36.501505 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.501599 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 13:46:36.501796 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 13:46:36.501881 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.502083 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.502177 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.502397 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.502483 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.502722 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830787-2-iscsi {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.502809 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.503046 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.503133 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.503353 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.503439 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.503681 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.503786 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.504002 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.504096 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.504307 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.504393 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.504632 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.504727 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.504935 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.505020 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.505261 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.505433 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.506672 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830787-2-iscsi {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.506824 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.506968 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.507103 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.507225 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.507353 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.507488 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.507612 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.507762 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.507898 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.508033 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.508170 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.508295 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.508425 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.508545 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.508675 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.508797 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.508945 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.509073 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.509195 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.509308 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.509443 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830787-2-iscsi {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.509568 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.509698 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.509821 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.509932 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.510063 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.510186 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.510304 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.510426 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.510556 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.510668 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.510798 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.511420 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.511546 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.511811 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.511949 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.512158 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830787-2-iscsi {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.512300 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.512476 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.512606 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.512791 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.512916 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.513107 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.513241 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.513477 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.513611 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.513801 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.513925 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.514105 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.514232 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.514415 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.514550 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.514725 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.514864 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.515045 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.515168 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.515347 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.515480 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.515673 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.515805 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.515927 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.516049 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.516223 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.516352 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.516545 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.516686 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.516869 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.517003 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.517191 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.517324 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.517446 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.517579 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.517702 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.517839 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.517994 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.518122 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.518317 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.518445 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.518626 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.518766 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.518934 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.519060 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.519239 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.519364 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.519545 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.519688 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.519843 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.519979 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.520109 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.520233 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.520408 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.520714 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.520847 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.520972 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.521108 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.521246 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.521379 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.521503 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.521627 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.521749 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.521962 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.522100 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.522225 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.522386 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.522523 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.522649 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.522779 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.522912 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.523082 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.523211 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.523405 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.523540 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.523746 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.523890 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.524072 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.524206 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.524381 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.524508 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.524705 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.524841 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.525032 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.525165 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.525338 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.525474 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.525645 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.525773 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.525966 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.526099 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.526295 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.526426 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.527160 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.527299 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.527468 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.527605 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.527798 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.527936 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.528106 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.528235 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.528420 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.528544 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.528722 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.528860 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.529028 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.529155 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.529335 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.529468 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.529634 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.529774 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.529898 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.530027 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.530194 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.530326 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.530500 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.530644 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.530819 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.530954 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.531123 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.531250 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.531426 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.531564 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.531748 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.531876 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.532079 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.532206 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.532338 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.532472 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.532632 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.532757 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.532940 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.533068 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.533243 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.533377 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.533548 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.533720 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.533847 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.533968 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.534143 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.534279 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.534447 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.534572 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.534753 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.534878 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.535057 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.535193 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.535377 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.535501 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.535703 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.535843 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.536009 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.536145 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.536395 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.536508 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.536640 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.536773 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.536977 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.537104 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.537226 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.537349 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.537504 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.537641 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.537807 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.537934 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.538125 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.538244 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.538431 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.538552 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.538735 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.538864 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.539037 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.539168 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.539340 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.539464 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.539697 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.539839 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.539971 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.540094 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.540254 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.540392 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.540556 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.540682 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.540860 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.540994 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.541166 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.541299 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.541471 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.541597 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.541777 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.541910 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.542095 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.542292 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.542399 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.542483 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.542707 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.542806 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.543010 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.543110 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.543312 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.543447 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.543657 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.543819 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.543976 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.544144 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.544285 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.544480 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.544611 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.544816 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.544953 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.545137 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.545264 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:46:36.545451 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.545579 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.545764 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.545900 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.546090 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.546226 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.546404 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.546550 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.546718 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.546854 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.547029 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.547162 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.547349 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.547483 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.547686 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.547819 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.548019 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.548147 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.548336 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.548463 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.548656 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.548786 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.548973 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.549110 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.549284 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.549413 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.549586 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.549714 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.549913 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.550038 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.550231 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.550356 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.550542 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.550670 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.550860 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.550986 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.551182 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.551323 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.551498 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.551664 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.551845 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.551977 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.552237 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.552625 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.552750 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.552874 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.553034 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.553169 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.553345 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.553485 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.553667 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.553786 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.554006 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.554142 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.554319 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.554455 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.554636 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.554771 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.554948 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.555073 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.555257 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.555391 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.555566 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.555768 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.555896 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.556027 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.556197 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.556338 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.556532 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.556660 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.556845 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.556973 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.557159 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.557285 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.557467 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.557599 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.558303 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.558492 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.558635 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.558794 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.558943 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.559216 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.559345 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.559533 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.559732 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.559861 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.559985 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.560163 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.560290 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.560471 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.560681 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.560814 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.560938 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.561061 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.561183 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.561377 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.561504 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.561685 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.561812 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.561992 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.562126 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.562346 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.562484 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.562610 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.562743 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.562901 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.563030 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.563211 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.563342 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.563521 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.563679 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.563851 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.563978 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.564161 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.564291 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.564473 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.564602 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.564779 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.564916 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.565090 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.565223 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.565401 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.565535 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.565705 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.565839 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.566019 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.566154 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.566322 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.566449 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.566628 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.566765 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.566943 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.567070 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.567253 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.567386 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.567560 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.567722 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.567901 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.568038 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.568212 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.568347 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.568517 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.568644 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.568835 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.568963 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.569145 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.569271 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.569456 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.569589 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.569772 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.569900 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.570085 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.570212 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.570402 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.570530 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.570716 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.570835 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.571031 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.571159 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.571336 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.571463 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.571674 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.571806 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.571971 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.572117 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.572277 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.572421 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.572619 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.572755 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.572887 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.573026 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.573161 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.573286 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.574008 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.574212 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.574364 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.574497 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.574665 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.574800 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.574971 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.575101 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.575289 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.575430 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.575597 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.575744 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.575941 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.576079 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.576247 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.576382 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.576552 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.576678 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.576859 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.577001 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.577182 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.577312 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.577493 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.577621 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.577799 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.577927 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.578105 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.578242 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.578409 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.578536 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.578751 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.578879 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.579057 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.579188 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.579367 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.579500 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.579703 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.579852 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.580020 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.580155 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.580331 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.580459 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.580652 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.580788 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.580970 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.581099 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.581281 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.581407 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.581590 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.581724 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.581901 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.582027 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.582211 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.582346 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.582530 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.582745 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.582874 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.583004 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.583135 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.583259 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.583448 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.583586 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.583800 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.583929 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.584115 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.584241 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.584434 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.584555 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.584742 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.584869 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.585055 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.585182 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.585369 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.585499 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.585680 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.585808 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.585990 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.586118 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.586299 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.586435 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.586622 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.586750 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.586934 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.587062 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.587244 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.587371 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.587553 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.587718 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.587890 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.588038 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.588202 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.588336 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.588521 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.588650 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.588828 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.588965 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.589232 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.589366 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.589606 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.589752 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.589878 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.590077 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.590213 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.590345 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.590471 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.590594 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.590760 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.590921 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.591078 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.591242 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.591410 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.591538 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.591777 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.591922 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.592094 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.592223 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.592408 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.592536 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.592781 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.592920 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.593045 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.593158 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.593344 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.593471 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.593659 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.593788 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.593963 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.594097 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.594271 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.594396 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.594580 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.594698 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.594887 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.595016 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.595192 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.595321 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.595503 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.595742 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.595871 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.596009 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.596142 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.596276 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.596446 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.596587 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.596755 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.596890 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.597059 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.597195 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.597366 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.597495 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.597691 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.597816 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.598002 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.598143 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.598309 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.598438 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.598615 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.598750 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.598920 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.599056 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.599227 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.599360 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.599554 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.599699 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.599884 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.600013 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.600202 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.600328 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.600509 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.600638 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.600816 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.600945 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.601136 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.601263 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.601446 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.601574 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.601756 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.601883 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.602076 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.602205 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.602389 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.602523 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.602699 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.602844 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.603034 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.603188 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.603323 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.603457 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.603606 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.603804 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.603928 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.604063 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.604249 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.604393 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.604561 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.604717 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.604992 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.605155 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.605336 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.605478 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.605612 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.605743 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.605868 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.605992 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.606114 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.606295 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.606609 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.606735 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.606923 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.607051 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.607238 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.607392 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.607547 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.607707 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.607896 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.608033 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.608218 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.608349 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.608558 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.608793 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.608920 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.609135 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.609275 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.609457 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.609612 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.609787 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.609915 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.610103 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.610230 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.610410 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.610546 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.610724 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.610853 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.611093 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.611219 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.611353 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.611479 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.611664 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.611807 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.611959 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.612088 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.612266 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.612404 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.612570 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.612706 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.612877 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.613021 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.613221 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.613353 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.613479 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.613628 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.613790 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.613920 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.614116 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.614244 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.614395 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.614523 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.614698 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.614825 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.615009 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.615147 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.615303 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.615428 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.615607 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.615764 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.615934 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.616072 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.616253 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.616379 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.616561 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.616690 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.616890 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.617027 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.617207 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.617335 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.617516 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.617658 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.617824 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.617953 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.618131 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.618262 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.618455 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.618591 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.618761 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.618889 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.619066 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.619195 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.619373 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.619517 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.619693 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.619820 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.620003 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.620133 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.620833 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.621064 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.621202 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.621403 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.621531 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.621715 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.621852 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.622028 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.622164 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.622329 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.622455 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.622637 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.622775 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.622942 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.623071 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.623279 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.623413 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.623538 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.623699 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.623867 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.623996 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.624173 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.624303 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.624484 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.624620 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.624791 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.624918 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.625098 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.625228 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.625411 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.625524 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.625712 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.625801 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.626021 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.626106 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.626325 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.626411 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.626628 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.626712 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.626930 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.627014 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.627240 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.627325 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.627546 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.627661 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.627876 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.627974 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.628189 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.628276 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.628498 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.628584 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.628804 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.628900 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.629106 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.629190 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.629409 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.629492 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.629711 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.629802 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.630016 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.630108 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.630320 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.630411 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.630642 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.630736 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.630955 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.631040 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.631258 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.631341 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.631568 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.631763 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.631895 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.631979 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.632201 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.632285 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.632504 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.632595 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.632812 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.632896 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.633118 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.633202 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.633420 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.633527 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.633726 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.633830 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.634029 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.634114 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.634332 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.634428 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.634637 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.634739 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.634945 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.635047 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.635250 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.635345 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.635553 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.635656 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.635931 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.636644 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.636862 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.636952 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.637200 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.637343 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.637564 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.637658 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.637887 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.637980 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.638207 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.638299 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.638530 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.638624 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.638844 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.638937 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.639156 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.639241 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.639472 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.639565 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.639804 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.639906 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.640123 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.640209 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.640435 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.640522 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.640751 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.640844 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.641066 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.641152 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.641373 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.641459 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.641688 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.641773 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.642003 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.642092 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.642311 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.642396 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.642634 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.642718 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.642949 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.643033 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.643269 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.643354 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.643573 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.643719 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.643913 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.644001 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.644228 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.644316 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.644539 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.644623 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.644853 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.644945 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.645162 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.645260 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.645477 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.645573 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.645788 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.645883 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.646101 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.646194 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.646412 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.646508 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.646723 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.646818 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.647032 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.647117 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.647388 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.647503 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.647670 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.647779 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.647983 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.648069 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.648296 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.648380 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.648612 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.648698 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.648918 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.649001 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.649229 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.649314 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.649535 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.649619 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.649844 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.649937 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.650150 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.650241 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.650457 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.650591 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.650787 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.650909 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.651104 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.651226 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.651415 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.651571 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.651849 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.651945 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.652164 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.652257 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.652479 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.652571 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.652789 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.652875 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.653135 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.653228 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.653525 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.653608 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.653842 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.653969 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.654152 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.654245 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.654465 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.654550 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.654773 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.654866 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.655079 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.655176 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.655391 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.655489 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.655741 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.655837 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.656050 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.656163 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.656359 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.656479 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.656665 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.656794 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.656991 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.657110 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.657300 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.657419 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.657625 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.657716 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.658030 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.658115 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.658342 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.658426 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.658657 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.658740 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.658968 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.659074 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.659276 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.659390 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.659603 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.659805 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.659939 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.660025 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.660268 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.660354 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.660667 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.660759 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.660982 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.661067 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.661291 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.661375 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.661600 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.661693 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.661929 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.662014 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.662256 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.662423 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.662570 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.662656 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.662886 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.662980 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.663193 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.663286 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.663518 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.663604 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.663869 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.663971 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.664188 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.664285 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.664514 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.664599 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.664841 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.664925 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.665160 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.665244 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.665487 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.665571 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.665801 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.665897 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.666125 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.666211 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.666451 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.666544 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.666754 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.666838 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.667065 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.667173 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.667396 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.667690 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.667792 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.668026 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.668111 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.668343 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.668428 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.668667 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.668753 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.668999 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.669083 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.669305 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.669390 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.669613 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.669698 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.669915 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.669998 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.670223 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.670308 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.670531 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.670623 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.670854 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.670946 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.671165 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.671250 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.671482 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.671569 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.671825 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.671911 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.672132 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.672229 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.672440 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.672525 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.672748 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.672840 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.673052 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.673144 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.673357 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.673443 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.673661 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.673746 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.673988 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.674081 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.674299 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.674386 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.674620 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.674706 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.674928 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.675020 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.675254 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.675339 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.675573 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.675680 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.675913 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.676016 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.676221 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.676307 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.676527 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.676612 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.676853 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.676938 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.677167 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.677257 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.677729 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.677822 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.678037 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.678123 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.678350 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.678435 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.678657 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.678750 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.678962 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.679047 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.679269 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.679355 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.679581 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.679713 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.679913 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.679999 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.680229 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.680321 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.680535 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.680629 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.680865 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.680956 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.681170 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.681254 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.681476 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.681568 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.681785 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.681870 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.682090 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.682174 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.682398 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.682484 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.682704 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.683287 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.683518 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.683796 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.684035 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.684122 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.684369 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.684453 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.684681 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.684765 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.685023 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.685109 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.685339 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.685424 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.685651 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.685734 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.685970 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.686083 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.686289 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.686380 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.686620 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.686724 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.686929 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.687021 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.687246 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.687337 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.687564 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.687702 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.687910 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.688010 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.688229 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.688322 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.688544 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.688650 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.688864 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.688985 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.689183 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.689275 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.689499 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.689603 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.689818 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.690021 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.690140 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.690350 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.690451 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.690667 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.690774 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.690982 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.691106 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.691303 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.691405 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.691617 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.691728 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.691951 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.692044 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.692265 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.692371 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.692577 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.692841 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.692948 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.693172 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.693265 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.693491 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.693605 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.693814 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.693905 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.694130 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.694227 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.694450 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.694541 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.694766 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.694861 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.695079 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.695191 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.695389 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.695475 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.695722 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.695812 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.696046 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.696154 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.696380 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.696473 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.696686 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.696784 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.697000 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.697104 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.697316 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.697409 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.697631 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.697724 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.697943 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.698036 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.698253 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.698369 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.699113 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.699328 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.699421 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.699720 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.699829 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.700043 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.700136 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.700353 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.700446 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.700665 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.700757 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.700981 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.701085 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.701300 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.701399 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.701614 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.701719 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.701930 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.702035 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.702243 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.702334 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.702556 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.702646 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.702871 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.703076 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.703169 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.703394 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.703494 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.703753 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.703859 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.704084 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.704177 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.704426 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.704518 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.704728 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.704830 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.705047 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.705140 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.705369 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.705459 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.705673 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.705774 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.705980 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.706211 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.706310 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.706530 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.706622 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.706867 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.706967 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.707189 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.707280 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.707502 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.707603 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.707832 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.707933 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.708153 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.708253 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.708464 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.708566 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.708784 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.708999 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.709091 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.709347 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.709440 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.709685 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.709781 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.709980 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.710078 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.710302 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.710390 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.710617 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.710705 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.710924 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.711018 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.711244 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.711342 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.711553 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.711666 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.711887 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.712120 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.712214 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.712474 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.712572 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.712799 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.712896 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.713107 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.713199 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.713421 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.713526 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.713734 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.713829 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.714083 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.714177 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.714416 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.714509 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.714728 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.714820 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.715039 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.715141 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.715360 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.715453 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.715684 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.715789 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.715997 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.716111 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.716311 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.716416 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.716615 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.716714 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.716920 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.717077 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.717227 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.717312 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.717532 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.717617 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.717838 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.717935 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.718140 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.718232 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.718452 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.718537 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.718757 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.718843 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.719067 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.719152 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.719372 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.719457 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.719703 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.719793 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.720014 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.720098 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.720326 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.720425 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.720636 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.720733 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.720952 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.721070 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.721260 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.721347 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.721569 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.721655 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.721875 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.721960 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.722191 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.722277 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.722502 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.722604 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.722812 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.722915 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.723155 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.723260 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.723482 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.723713 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.723887 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.724056 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.724157 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.724380 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.724477 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.724719 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.724826 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.725067 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.725160 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.725391 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.725493 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.725668 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.725754 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.725977 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.726064 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.726304 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.726454 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.726617 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.726850 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.726936 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.727193 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.727280 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.727529 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.727614 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.727855 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.727949 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.728167 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.728256 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.728478 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.728564 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.728787 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.728872 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.729097 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.729184 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.729406 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.729491 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.729741 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.729842 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.730051 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.730139 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.730365 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.730448 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.730680 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.730774 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.730993 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.731078 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.731305 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.731400 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.731620 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.731745 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.731957 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.732050 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.732270 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.732355 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.732585 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.732695 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.732898 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.732998 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.733207 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.733299 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.733522 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.733614 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.733856 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.733951 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.734175 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.734269 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.734485 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.734578 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.734803 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.734905 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.735127 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.735237 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.735442 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.735542 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.735782 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.735876 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.736105 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.736207 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.736419 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.736533 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.736740 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.736832 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.737074 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.737179 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.737392 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.737483 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.737703 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.737795 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.738033 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.738126 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.738378 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.738472 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.738712 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.738812 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.739040 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.739140 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.739351 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.739444 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.739678 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.739774 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.739988 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.740094 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.740299 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.740401 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.740619 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.740721 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.740935 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.741028 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.741243 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.741336 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.741549 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.741655 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.741859 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.741952 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.742166 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.742266 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.742470 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.742572 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.742776 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.742869 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.743091 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.743184 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.743399 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.743501 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.743727 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.743822 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.744037 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.744131 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.744340 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.744432 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.744644 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.744743 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.744948 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.745042 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.745777 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.745879 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.746092 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.746185 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.746398 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.746559 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.746706 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.746867 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.747009 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.747181 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.747314 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.747491 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.747618 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.747828 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.747970 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.748148 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.748307 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.748459 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.748625 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.748769 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.748951 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.749079 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.749265 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.749392 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.749591 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.749699 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.749901 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.750008 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.750225 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.750322 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.750550 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.750637 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.750867 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.750952 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.751183 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.751276 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.751517 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.751603 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.751854 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.751949 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.752170 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.752257 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.752483 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.752574 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.752800 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.752898 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.753112 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.753204 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.753438 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.753531 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.753762 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.753861 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.754108 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.754199 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.754387 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.754479 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.754715 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.754818 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.755027 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.755119 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.755344 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.755437 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.755677 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.755785 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.755994 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.756086 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.756310 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.756402 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.756624 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.756726 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.756935 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.757027 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.757253 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.757346 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.757564 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.757667 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.757876 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.757969 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.758194 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.758295 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.758515 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.758609 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.758834 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.758926 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.759152 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.759244 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.759480 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.759572 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.759820 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.759913 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.760135 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.760239 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.760456 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.760625 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.760772 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.760968 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.761174 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.761336 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.761533 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.761688 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.761910 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.762065 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.762211 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.762365 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.762512 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 13:46:36.762669 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.762883 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.763218 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.763572 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.763920 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.764270 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.764604 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.764924 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.765242 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.765553 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:46:36.765804 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 13:46:36.785489 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG oslo_db.sqlalchemy.engines [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:46:36.788251 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_db.sqlalchemy.engines [None req-67745857-44c3-4091-9a20-9a6d00cff894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:46:36.849397 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.context [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a3c738a4-30d8-4063-acdb-1d2725038730(cell1) {{(pid=102580) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 13:46:36.850188 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.context [None req-67745857-44c3-4091-9a20-9a6d00cff894 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a3c738a4-30d8-4063-acdb-1d2725038730(cell1) {{(pid=102581) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 13:46:36.855705 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:46:36.856610 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-67745857-44c3-4091-9a20-9a6d00cff894 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:46:36.857375 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:46:36.858192 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:46:36.858296 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-67745857-44c3-4091-9a20-9a6d00cff894 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:46:36.859052 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-67745857-44c3-4091-9a20-9a6d00cff894 None None] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:46:36.860135 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG oslo_concurrency.lockutils [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:46:36.861003 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-67745857-44c3-4091-9a20-9a6d00cff894 None None] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:46:36.870555 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG oslo_db.sqlalchemy.engines [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:46:36.876298 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_db.sqlalchemy.engines [None req-67745857-44c3-4091-9a20-9a6d00cff894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:46:36.877136 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_db.sqlalchemy.engines [None req-67745857-44c3-4091-9a20-9a6d00cff894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:46:37.013447 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG oslo_db.sqlalchemy.engines [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:46:37.034415 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG oslo_db.sqlalchemy.engines [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:46:37.037638 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_db.sqlalchemy.engines [None req-67745857-44c3-4091-9a20-9a6d00cff894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:46:37.492782 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: WARNING keystonemiddleware.auth_token [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 13:46:37.493001 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: WARNING keystonemiddleware.auth_token [None req-67745857-44c3-4091-9a20-9a6d00cff894 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 13:46:37.499840 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: WARNING keystonemiddleware.auth_token [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 13:46:37.500273 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: WARNING keystonemiddleware.auth_token [None req-67745857-44c3-4091-9a20-9a6d00cff894 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 13:46:37.722080 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: WARNING keystonemiddleware.auth_token [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 13:46:37.726589 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: WARNING keystonemiddleware.auth_token [None req-67745857-44c3-4091-9a20-9a6d00cff894 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 13:46:37.727243 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: WARNING keystonemiddleware.auth_token [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 13:46:37.732677 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: WARNING keystonemiddleware.auth_token [None req-67745857-44c3-4091-9a20-9a6d00cff894 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 13:46:37.732941 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1f84799c0 pid: 102580 (default app) Apr 11 13:46:37.735021 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:46:37.736221 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001766 Apr 11 13:46:37.736639 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Mon Apr 11 13:46:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:46:37.737821 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1f84799c0 pid: 102581 (default app) Apr 11 13:47:57.062769 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:47:57.063905 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Apr 11 13:47:57.070509 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 2/2] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:47:57 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:47:57.485272 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-b7ffe5f2-00bd-4c92-8c6c-a20bb79df0f7 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:47:57.515141 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-b7ffe5f2-00bd-4c92-8c6c-a20bb79df0f7 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.442657 Apr 11 13:47:57.515821 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 1/3] 10.222.0.67 () {60 vars in 1291 bytes} [Mon Apr 11 13:47:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:47:59.876464 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:47:59.877459 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-85030bd3-ae44-41a0-91ed-41bf4c8ecd98 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Apr 11 13:47:59.877848 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 3/4] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:47:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:47:59.938666 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-6736713a-8e4c-43d6-bd63-2e49ce7d9322 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 256, "rxtx_factor": 1.0}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:47:59.959195 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:47:59.959195 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: warnings.warn(msg) Apr 11 13:47:59.990062 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-6736713a-8e4c-43d6-bd63-2e49ce7d9322 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106151 Apr 11 13:47:59.990731 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 2/5] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Apr 11 13:47:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 13:48:00.231122 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-82e677be-c291-4ace-9d63-25ddf1c1d19f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:00.234488 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:48:00.234488 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: warnings.warn(msg) Apr 11 13:48:00.288720 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-82e677be-c291-4ace-9d63-25ddf1c1d19f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289873 Apr 11 13:48:00.289484 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 4/6] 10.222.0.67 () {64 vars in 1335 bytes} [Mon Apr 11 13:47:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:48:02.649557 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-6736713a-8e4c-43d6-bd63-2e49ce7d9322 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:02.650493 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-6736713a-8e4c-43d6-bd63-2e49ce7d9322 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Apr 11 13:48:02.651066 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 3/7] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:48:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:02.777294 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-b2ef2f63-6f8c-4133-a4da-01d36c6e9557 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "swap": 0, "ram": 512, "vcpus": 1}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:02.798744 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:48:02.798744 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: warnings.warn(msg) Apr 11 13:48:02.820801 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-b2ef2f63-6f8c-4133-a4da-01d36c6e9557 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.163525 Apr 11 13:48:02.821643 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 5/8] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Apr 11 13:48:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 13:48:02.833694 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-06287e6a-5277-4ae8-b0aa-f7a35eff4dc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:02.836016 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:48:02.836016 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: warnings.warn(msg) Apr 11 13:48:02.872056 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-06287e6a-5277-4ae8-b0aa-f7a35eff4dc0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042083 Apr 11 13:48:02.873208 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 4/9] 10.222.0.67 () {64 vars in 1335 bytes} [Mon Apr 11 13:48:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:48:05.222484 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-b2ef2f63-6f8c-4133-a4da-01d36c6e9557 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:05.223483 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-b2ef2f63-6f8c-4133-a4da-01d36c6e9557 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Apr 11 13:48:05.223912 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 6/10] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:48:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:05.284184 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-4a75e10a-9f45-4807-8be7-03e3aa01b895 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "id": "d2", "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:05.303800 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-4a75e10a-9f45-4807-8be7-03e3aa01b895 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073746 Apr 11 13:48:05.304344 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 5/11] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Apr 11 13:48:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:48:05.317822 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-6383e8e6-29ad-4657-83d4-4022e8dc7a29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:05.342515 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-6383e8e6-29ad-4657-83d4-4022e8dc7a29 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028244 Apr 11 13:48:05.343268 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 7/12] 10.222.0.67 () {64 vars in 1335 bytes} [Mon Apr 11 13:48:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:48:07.758034 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-4a75e10a-9f45-4807-8be7-03e3aa01b895 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:07.759080 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-4a75e10a-9f45-4807-8be7-03e3aa01b895 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Apr 11 13:48:07.759495 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 6/13] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:48:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:07.820872 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-60af91ec-0c18-4d3b-abbf-9c725abcb700 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:07.838126 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-60af91ec-0c18-4d3b-abbf-9c725abcb700 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072136 Apr 11 13:48:07.838675 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 8/14] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Apr 11 13:48:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:48:07.851084 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-3b56458f-5749-4225-b6f7-80dd1e90b0b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:07.875326 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-3b56458f-5749-4225-b6f7-80dd1e90b0b2 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028161 Apr 11 13:48:07.875954 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 7/15] 10.222.0.67 () {64 vars in 1335 bytes} [Mon Apr 11 13:48:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:48:10.230023 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-60af91ec-0c18-4d3b-abbf-9c725abcb700 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:10.231195 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-60af91ec-0c18-4d3b-abbf-9c725abcb700 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Apr 11 13:48:10.231972 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 9/16] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:48:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:10.292411 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-b759a0b9-f65a-4043-b751-a74f6751347d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:10.312866 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-b759a0b9-f65a-4043-b751-a74f6751347d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074323 Apr 11 13:48:10.314028 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 8/17] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Apr 11 13:48:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:48:10.325478 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-d7402ceb-e3bd-43f3-947f-34e2eb44f681 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:10.348574 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-d7402ceb-e3bd-43f3-947f-34e2eb44f681 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026709 Apr 11 13:48:10.349642 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 10/18] 10.222.0.67 () {64 vars in 1335 bytes} [Mon Apr 11 13:48:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:48:12.705325 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-b759a0b9-f65a-4043-b751-a74f6751347d admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:12.706572 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-b759a0b9-f65a-4043-b751-a74f6751347d admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 Apr 11 13:48:12.707473 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 9/19] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:48:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:12.768088 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-ef9525de-2a5e-4590-b264-ca7792c8580f admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:12.791020 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-ef9525de-2a5e-4590-b264-ca7792c8580f admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076770 Apr 11 13:48:12.791548 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 11/20] 10.222.0.67 () {60 vars in 1291 bytes} [Mon Apr 11 13:48:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:48:15.493629 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-b759a0b9-f65a-4043-b751-a74f6751347d admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:15.494635 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-b759a0b9-f65a-4043-b751-a74f6751347d admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Apr 11 13:48:15.495029 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 10/21] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:48:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:15.553682 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-bf4b627b-5605-45de-97ef-aafd65858d35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1"}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:15.572805 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-bf4b627b-5605-45de-97ef-aafd65858d35 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071243 Apr 11 13:48:15.574037 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 12/22] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Apr 11 13:48:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:48:15.589244 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-88434438-51e1-413f-870c-4f45843c3828 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:15.616230 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-88434438-51e1-413f-870c-4f45843c3828 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031831 Apr 11 13:48:15.616844 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 11/23] 10.222.0.67 () {64 vars in 1332 bytes} [Mon Apr 11 13:48:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:48:18.016784 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-bf4b627b-5605-45de-97ef-aafd65858d35 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:18.017887 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-bf4b627b-5605-45de-97ef-aafd65858d35 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Apr 11 13:48:18.018367 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:48:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:18.091938 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-66981a82-e013-449a-8a82-d5a9823b34f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "disk": 20, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:18.113427 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-66981a82-e013-449a-8a82-d5a9823b34f2 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088966 Apr 11 13:48:18.114136 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 12/25] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Apr 11 13:48:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:48:18.127894 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-f29b235c-5ddf-4782-9edc-d846d7aee64c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:18.149973 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-f29b235c-5ddf-4782-9edc-d846d7aee64c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025996 Apr 11 13:48:18.150543 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 14/26] 10.222.0.67 () {64 vars in 1332 bytes} [Mon Apr 11 13:48:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:48:20.755687 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-66981a82-e013-449a-8a82-d5a9823b34f2 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:20.756701 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-66981a82-e013-449a-8a82-d5a9823b34f2 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Apr 11 13:48:20.757108 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:48:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:20.814114 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-1c9594a8-8ae6-4fb5-b886-c700aaffc04e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:20.832278 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-1c9594a8-8ae6-4fb5-b886-c700aaffc04e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069571 Apr 11 13:48:20.832831 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 15/28] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Apr 11 13:48:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:48:20.845209 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-b988e169-53d2-4632-b222-a38bd41940ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:20.867907 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-b988e169-53d2-4632-b222-a38bd41940ad admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027191 Apr 11 13:48:20.868470 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 14/29] 10.222.0.67 () {64 vars in 1332 bytes} [Mon Apr 11 13:48:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:48:23.262533 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-1c9594a8-8ae6-4fb5-b886-c700aaffc04e admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:23.263539 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-1c9594a8-8ae6-4fb5-b886-c700aaffc04e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Apr 11 13:48:23.263989 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 16/30] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:48:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:23.330049 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-637221bf-c3ed-4590-b568-f9706d08ac2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "vcpus": 4, "ram": 8192, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:23.349659 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-637221bf-c3ed-4590-b568-f9706d08ac2b admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077994 Apr 11 13:48:23.350304 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 15/31] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Apr 11 13:48:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:48:23.362648 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-c995e4d8-8c32-49fc-83be-e94e0e264aaa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:23.385527 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-c995e4d8-8c32-49fc-83be-e94e0e264aaa admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027156 Apr 11 13:48:23.386097 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 17/32] 10.222.0.67 () {64 vars in 1332 bytes} [Mon Apr 11 13:48:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:48:25.846199 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-637221bf-c3ed-4590-b568-f9706d08ac2b admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:25.847203 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-637221bf-c3ed-4590-b568-f9706d08ac2b admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Apr 11 13:48:25.847604 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 16/33] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:48:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:25.911808 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-b637adfa-84e2-4933-9a66-055f792a0815 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "swap": 0, "ram": 16384}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:25.931237 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-b637adfa-84e2-4933-9a66-055f792a0815 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077754 Apr 11 13:48:25.935766 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 18/34] 10.222.0.67 () {64 vars in 1282 bytes} [Mon Apr 11 13:48:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:48:25.944161 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-74b1581d-ab0a-4fdf-ae80-edb8df6bc5f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:25.970560 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-74b1581d-ab0a-4fdf-ae80-edb8df6bc5f0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029990 Apr 11 13:48:25.971146 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 17/35] 10.222.0.67 () {64 vars in 1332 bytes} [Mon Apr 11 13:48:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:48:49.460408 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-b637adfa-84e2-4933-9a66-055f792a0815 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:49.461414 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-b637adfa-84e2-4933-9a66-055f792a0815 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Apr 11 13:48:49.461808 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 19/36] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:48:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:49.518459 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-2a32872c-c20d-4126-a077-ac6e94c83d34 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:49.535441 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-2a32872c-c20d-4126-a077-ac6e94c83d34 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067712 Apr 11 13:48:49.536006 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1291 bytes} [Mon Apr 11 13:48:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:48:50.914357 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-b637adfa-84e2-4933-9a66-055f792a0815 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:50.915415 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-b637adfa-84e2-4933-9a66-055f792a0815 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Apr 11 13:48:50.915848 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 20/38] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Apr 11 13:48:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:51.117125 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-80167ea5-5dd4-4a45-8c4f-f97cfd3f9c92 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:51.122579 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.wsgi [None req-80167ea5-5dd4-4a45-8c4f-f97cfd3f9c92 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 11 13:48:51.123140 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-80167ea5-5dd4-4a45-8c4f-f97cfd3f9c92 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:48:51.124013 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-80167ea5-5dd4-4a45-8c4f-f97cfd3f9c92 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057261 Apr 11 13:48:51.125154 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Apr 11 13:48:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:51.134043 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-468eac39-ee08-44c3-883b-a294adcbf846 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:51.154313 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-468eac39-ee08-44c3-883b-a294adcbf846 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023765 Apr 11 13:48:51.154835 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 21/40] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Apr 11 13:48:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:48:51.164807 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-a679deb6-cbaf-4d8d-a623-d554692400f0 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:51.186119 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-a679deb6-cbaf-4d8d-a623-d554692400f0 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024789 Apr 11 13:48:51.186642 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Apr 11 13:48:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:48:51.195836 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-748316c7-2229-436d-ab20-7f024786aba1 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:51.201134 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.wsgi [None req-748316c7-2229-436d-ab20-7f024786aba1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 11 13:48:51.201699 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-748316c7-2229-436d-ab20-7f024786aba1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:48:51.202477 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-748316c7-2229-436d-ab20-7f024786aba1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010229 Apr 11 13:48:51.203657 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 22/42] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Apr 11 13:48:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:52.466794 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-a679deb6-cbaf-4d8d-a623-d554692400f0 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:52.467823 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-a679deb6-cbaf-4d8d-a623-d554692400f0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Apr 11 13:48:52.468249 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 21/43] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Apr 11 13:48:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:52.656986 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-ecabbdfa-64b7-495a-8e99-3cbc4cb1a0d1 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:52.662181 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.wsgi [None req-ecabbdfa-64b7-495a-8e99-3cbc4cb1a0d1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 11 13:48:52.662738 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-ecabbdfa-64b7-495a-8e99-3cbc4cb1a0d1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:48:52.663569 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-ecabbdfa-64b7-495a-8e99-3cbc4cb1a0d1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058608 Apr 11 13:48:52.664251 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Apr 11 13:48:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:52.674197 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-0af6243c-15ef-4bfd-aef0-1fb7cd2959c7 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:52.688265 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-0af6243c-15ef-4bfd-aef0-1fb7cd2959c7 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018325 Apr 11 13:48:52.688783 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 22/45] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Apr 11 13:48:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:48:52.697975 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-67861a68-f133-429a-8024-ecc56f04e2fe admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:52.711533 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-67861a68-f133-429a-8024-ecc56f04e2fe admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017090 Apr 11 13:48:52.712093 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Apr 11 13:48:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:48:52.721296 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-220b7bc6-76de-40a1-96a3-778398ddaeab admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:52.726394 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.wsgi [None req-220b7bc6-76de-40a1-96a3-778398ddaeab admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 11 13:48:52.726954 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-220b7bc6-76de-40a1-96a3-778398ddaeab admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:48:52.727756 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-220b7bc6-76de-40a1-96a3-778398ddaeab admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010042 Apr 11 13:48:52.728244 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 23/47] 10.222.0.67 () {60 vars in 1190 bytes} [Mon Apr 11 13:48:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:54.034143 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-67861a68-f133-429a-8024-ecc56f04e2fe admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:54.035665 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-67861a68-f133-429a-8024-ecc56f04e2fe admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Apr 11 13:48:54.036369 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 25/48] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Apr 11 13:48:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:54.238599 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-56c590a4-e7ec-4a56-b998-e7ad849d4b55 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:54.244430 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.wsgi [None req-56c590a4-e7ec-4a56-b998-e7ad849d4b55 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 11 13:48:54.245401 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-56c590a4-e7ec-4a56-b998-e7ad849d4b55 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:48:54.246208 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-56c590a4-e7ec-4a56-b998-e7ad849d4b55 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.065642 Apr 11 13:48:54.246735 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 24/49] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Apr 11 13:48:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:54.257308 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-3ef8d69e-b8ef-45b8-9e72-0d4b503a640e admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:54.271581 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-3ef8d69e-b8ef-45b8-9e72-0d4b503a640e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017800 Apr 11 13:48:54.272365 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 26/50] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Apr 11 13:48:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:48:54.282747 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:54.297854 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019384 Apr 11 13:48:54.298518 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 25/51] 10.222.0.67 () {60 vars in 1210 bytes} [Mon Apr 11 13:48:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:48:54.308635 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-d7d82855-6222-4698-aa2d-8df661533b06 admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:54.314234 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.wsgi [None req-d7d82855-6222-4698-aa2d-8df661533b06 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 11 13:48:54.314797 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-d7d82855-6222-4698-aa2d-8df661533b06 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:48:54.315595 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-d7d82855-6222-4698-aa2d-8df661533b06 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010682 Apr 11 13:48:54.316130 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 27/52] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Apr 11 13:48:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:55.600158 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:55.601159 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Apr 11 13:48:55.601550 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 26/53] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Apr 11 13:48:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:55.789512 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-3077a58b-4390-4df1-85fb-292f7f031bcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:55.806841 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-3077a58b-4390-4df1-85fb-292f7f031bcd admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067750 Apr 11 13:48:55.807361 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 28/54] 10.222.0.67 () {64 vars in 1235 bytes} [Mon Apr 11 13:48:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:48:57.075022 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:57.076047 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Apr 11 13:48:57.076495 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Apr 11 13:48:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:57.265787 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-2587142d-a4fd-4816-91cc-9b23a988a6c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:57.283063 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-2587142d-a4fd-4816-91cc-9b23a988a6c0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068181 Apr 11 13:48:57.283623 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 29/56] 10.222.0.67 () {64 vars in 1235 bytes} [Mon Apr 11 13:48:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:48:58.567901 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:48:58.568933 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Apr 11 13:48:58.569326 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 28/57] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Apr 11 13:48:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:48:58.764482 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-eed5685d-7367-4ce0-8199-8e4958dc3393 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:48:58.781425 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-eed5685d-7367-4ce0-8199-8e4958dc3393 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070228 Apr 11 13:48:58.782158 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 30/58] 10.222.0.67 () {64 vars in 1235 bytes} [Mon Apr 11 13:48:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:49:00.046230 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:49:00.048083 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 Apr 11 13:49:00.048483 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 29/59] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Apr 11 13:49:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:49:00.241609 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-1ea1bbf2-c8f2-43d7-a8ee-17fc52aa800e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:49:00.259563 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-1ea1bbf2-c8f2-43d7-a8ee-17fc52aa800e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069018 Apr 11 13:49:00.260108 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 31/60] 10.222.0.67 () {64 vars in 1235 bytes} [Mon Apr 11 13:49:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:49:01.534211 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:49:01.535527 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Apr 11 13:49:01.536047 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 30/61] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Apr 11 13:49:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 13:49:01.722792 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-cb23e20b-579d-4eef-b7b9-b31f395f302c admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:49:01.741554 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-cb23e20b-579d-4eef-b7b9-b31f395f302c admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070470 Apr 11 13:49:01.742069 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 32/62] 10.222.0.67 () {60 vars in 1202 bytes} [Mon Apr 11 13:49:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:50:04.947470 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:50:04.948529 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-58d21359-697b-4de0-a0ec-19194be362ac admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Apr 11 13:50:04.948922 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 31/63] 10.222.0.67 () {54 vars in 930 bytes} [Mon Apr 11 13:50:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:50:05.006750 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-b04abbf2-9b68-49cf-8e6d-119681241efc admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:50:05.025505 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-b04abbf2-9b68-49cf-8e6d-119681241efc admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070818 Apr 11 13:50:05.026028 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 33/64] 10.222.0.67 () {60 vars in 1291 bytes} [Mon Apr 11 13:50:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:50:05.049260 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-e7aff367-f546-45a6-b288-7283be45c98f admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:50:05.056757 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-e7aff367-f546-45a6-b288-7283be45c98f admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012203 Apr 11 13:50:05.057268 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 32/65] 10.222.0.67 () {60 vars in 1282 bytes} [Mon Apr 11 13:50:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:50:05.068435 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-f170eed1-9856-4460-94b6-c2d4d4ddb2de admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:50:05.075803 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-f170eed1-9856-4460-94b6-c2d4d4ddb2de admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010821 Apr 11 13:50:05.076315 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 34/66] 10.222.0.67 () {60 vars in 1285 bytes} [Mon Apr 11 13:50:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:50:05.087494 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-64456612-167b-4fa0-b2b6-f1b4f0d17fb4 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:50:05.094884 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-64456612-167b-4fa0-b2b6-f1b4f0d17fb4 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011014 Apr 11 13:50:05.095901 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 33/67] 10.222.0.67 () {60 vars in 1285 bytes} [Mon Apr 11 13:50:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:50:05.106844 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-b3ab09fc-8a92-4fcb-9d63-cf429d4dc49e admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:50:05.115072 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-b3ab09fc-8a92-4fcb-9d63-cf429d4dc49e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011690 Apr 11 13:50:05.115586 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 35/68] 10.222.0.67 () {60 vars in 1282 bytes} [Mon Apr 11 13:50:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:51:46.129333 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-99e92435-7d04-4ae7-9d25-6bf24ac6e7cb tempest-verify_tempest_config-2092675186 tempest-verify_tempest_config-2092675186-project] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:51:46.131287 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-99e92435-7d04-4ae7-9d25-6bf24ac6e7cb tempest-verify_tempest_config-2092675186 tempest-verify_tempest_config-2092675186-project] 10.222.0.67 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.111200 Apr 11 13:51:46.131856 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 34/69] 10.222.0.67 () {58 vars in 1133 bytes} [Mon Apr 11 13:51:46 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:53:26.100247 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-b3ab09fc-8a92-4fcb-9d63-cf429d4dc49e admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:53:26.101257 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-b3ab09fc-8a92-4fcb-9d63-cf429d4dc49e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Apr 11 13:53:26.101663 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 36/70] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Apr 11 13:53:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:53:26.353753 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-48438a24-9513-4fe0-b981-09a33e732cf4 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:53:26.355547 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:53:26.355547 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: warnings.warn(msg) Apr 11 13:53:26.356839 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-48438a24-9513-4fe0-b981-09a33e732cf4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:53:26.357928 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-48438a24-9513-4fe0-b981-09a33e732cf4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:53:26.359144 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-48438a24-9513-4fe0-b981-09a33e732cf4 admin admin] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:53:26.359600 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-48438a24-9513-4fe0-b981-09a33e732cf4 admin admin] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:53:26.400617 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-48438a24-9513-4fe0-b981-09a33e732cf4 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.162033 Apr 11 13:53:26.402615 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 35/71] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Apr 11 13:53:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:53:27.685021 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-b3ab09fc-8a92-4fcb-9d63-cf429d4dc49e admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:53:27.686032 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-b3ab09fc-8a92-4fcb-9d63-cf429d4dc49e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Apr 11 13:53:27.686430 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 37/72] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Apr 11 13:53:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:53:27.879246 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-d86864de-db2b-4aac-b195-38bc3ef73533 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:53:27.880451 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:53:27.880451 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: warnings.warn(msg) Apr 11 13:53:27.881661 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-d86864de-db2b-4aac-b195-38bc3ef73533 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:53:27.882135 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-d86864de-db2b-4aac-b195-38bc3ef73533 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:53:27.882920 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-d86864de-db2b-4aac-b195-38bc3ef73533 admin admin] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:53:27.883346 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-d86864de-db2b-4aac-b195-38bc3ef73533 admin admin] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:53:27.903080 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-d86864de-db2b-4aac-b195-38bc3ef73533 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075617 Apr 11 13:53:27.903549 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 36/73] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Apr 11 13:53:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:53:39.594702 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-b3ab09fc-8a92-4fcb-9d63-cf429d4dc49e admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:53:39.595726 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-b3ab09fc-8a92-4fcb-9d63-cf429d4dc49e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Apr 11 13:53:39.596124 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 38/74] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Apr 11 13:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:53:39.784894 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-3350a595-55da-44c8-a82c-7875e0075ef4 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:53:39.786041 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:53:39.786041 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: warnings.warn(msg) Apr 11 13:53:39.787267 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-3350a595-55da-44c8-a82c-7875e0075ef4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:53:39.787742 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-3350a595-55da-44c8-a82c-7875e0075ef4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:53:39.788544 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-3350a595-55da-44c8-a82c-7875e0075ef4 admin admin] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:53:39.788965 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-3350a595-55da-44c8-a82c-7875e0075ef4 admin admin] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:53:39.813805 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-3350a595-55da-44c8-a82c-7875e0075ef4 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080449 Apr 11 13:53:39.814339 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 37/75] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Apr 11 13:53:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:53:41.070552 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: DEBUG nova.api.openstack.wsgi [None req-b3ab09fc-8a92-4fcb-9d63-cf429d4dc49e admin admin] Calling method '>' {{(pid=102580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:53:41.071557 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: INFO nova.api.openstack.requestlog [None req-b3ab09fc-8a92-4fcb-9d63-cf429d4dc49e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Apr 11 13:53:41.071979 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: [pid: 102580|app: 0|req: 39/76] 10.222.0.67 () {56 vars in 1074 bytes} [Mon Apr 11 13:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:53:41.264978 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-c94ee96e-829c-4a90-9b1c-2c67a1910c12 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:53:41.266138 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:53:41.266138 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: warnings.warn(msg) Apr 11 13:53:41.267310 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-c94ee96e-829c-4a90-9b1c-2c67a1910c12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:53:41.267794 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-c94ee96e-829c-4a90-9b1c-2c67a1910c12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:53:41.268582 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-c94ee96e-829c-4a90-9b1c-2c67a1910c12 admin admin] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:53:41.269014 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-c94ee96e-829c-4a90-9b1c-2c67a1910c12 admin admin] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:53:41.290374 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-c94ee96e-829c-4a90-9b1c-2c67a1910c12 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083073 Apr 11 13:53:41.290851 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 38/77] 10.222.0.67 () {60 vars in 1193 bytes} [Mon Apr 11 13:53:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:54:38.442791 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: Mon Apr 11 13:54:38 2022 - graceful shutdown triggered... Apr 11 13:54:38.442907 dv-cinder-830787-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 11 13:54:38.443803 dv-cinder-830787-2-iscsi devstack@n-api.service[102580]: Gracefully killing worker 1 (pid: 102580)... Apr 11 13:54:38.444185 dv-cinder-830787-2-iscsi devstack@n-api.service[102581]: Gracefully killing worker 2 (pid: 102581)... Apr 11 13:54:39.443949 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: worker 1 buried after 1 seconds Apr 11 13:54:39.444403 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: worker 2 buried after 1 seconds Apr 11 13:54:39.444403 dv-cinder-830787-2-iscsi devstack@n-api.service[102579]: goodbye to uWSGI. Apr 11 13:54:39.445527 dv-cinder-830787-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 11 13:54:39.446111 dv-cinder-830787-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 11 13:54:39.448854 dv-cinder-830787-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 11 13:54:39.467384 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Apr 11 13:54:39 2022] *** Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: nodename: dv-cinder-830787-2-iscsi Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: machine: x86_64 Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: clock source: unix Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: pcre jit disabled Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: detected number of CPU cores: 4 Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: current working directory: / Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: detected binary path: /usr/bin/uwsgi-core Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: your processes number limit is 47680 Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: your memory page size is 4096 bytes Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: detected max file descriptor number: 2048 Apr 11 13:54:39.487774 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: lock engine: pthread robust mutexes Apr 11 13:54:39.488834 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: thunder lock: enabled Apr 11 13:54:39.488834 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 11 13:54:39.488834 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 11 13:54:39.532394 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: Python main interpreter initialized at 0x55f69dd769c0 Apr 11 13:54:39.532394 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: python threads support enabled Apr 11 13:54:39.532394 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: your server socket listen backlog is limited to 100 connections Apr 11 13:54:39.532394 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: your mercy for graceful operations on workers is 90 seconds Apr 11 13:54:39.532808 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: mapped 403077 bytes (393 KB) for 2 cores Apr 11 13:54:39.532808 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: *** Operational MODE: preforking *** Apr 11 13:54:39.533070 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: *** uWSGI is running in multiple interpreter mode *** Apr 11 13:54:39.533070 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: spawned uWSGI master process (pid: 116924) Apr 11 13:54:39.533282 dv-cinder-830787-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 11 13:54:39.534214 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: spawned uWSGI worker 1 (pid: 116941, cores: 1) Apr 11 13:54:39.534358 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: spawned uWSGI worker 2 (pid: 116942, cores: 1) Apr 11 13:54:39.535653 dv-cinder-830787-2-iscsi devstack@n-api.service[116924]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 13:54:40.749096 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 13:54:40.757522 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 13:54:41.673670 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 13:54:41.673670 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: from cryptography.utils import int_from_bytes Apr 11 13:54:41.673951 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 13:54:41.673951 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: from cryptography.utils import int_from_bytes Apr 11 13:54:41.690868 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 13:54:41.690868 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: from cryptography.utils import int_from_bytes Apr 11 13:54:41.691212 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 13:54:41.691212 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: from cryptography.utils import int_from_bytes Apr 11 13:54:44.071899 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 13:54:44.072516 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 13:54:44.072802 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 13:54:44.073070 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 13:54:44.073334 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 13:54:44.073733 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.074070 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.074403 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.074735 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.075076 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.075398 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.075759 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.076095 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.076433 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.076710 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.077043 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.077378 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830787-2-iscsi {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.077710 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.078027 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.078350 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.078679 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.078996 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.079332 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.079665 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.080189 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.081653 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.081653 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.081653 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.081653 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.081956 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.082228 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.082562 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.082898 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.083221 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.083542 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.083996 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830787-2-iscsi {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.084324 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.084650 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.084981 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.085411 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.085737 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.086060 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.086394 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.086733 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.087062 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.087395 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.088269 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.088680 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.088933 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.089246 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.089568 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.089888 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.090219 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.090562 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.090856 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.091116 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.091436 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.091794 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.092130 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.092466 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.092762 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.092988 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.093362 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.093651 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.093971 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.094293 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.094613 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.094930 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.095257 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.095570 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.095911 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.096230 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.096561 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.096897 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.097233 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.097555 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.097889 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.098304 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.098565 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.098886 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.099242 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.099573 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.099923 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.100256 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.100588 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.101772 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.101772 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.101772 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.102358 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.102358 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.102649 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.102818 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.103085 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.104066 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.104377 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.104706 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.105024 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.105344 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.105661 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.105982 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.106305 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.106630 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.106949 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.107313 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.107592 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.107928 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.108263 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.108566 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.108897 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.109172 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 13:54:44.109688 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.109834 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 13:54:44.110058 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.110058 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.110337 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 13:54:44.110490 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.110641 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 13:54:44.110798 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.110959 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 13:54:44.111116 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.111279 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.111435 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.111578 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.111762 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.111918 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.112067 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.112219 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.112368 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.112521 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.112673 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.112815 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.112962 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.113133 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.113363 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.113516 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.113671 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.113821 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.113963 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.114114 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.114315 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.114554 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.114715 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.114972 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830787-2-iscsi {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.115127 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.115271 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.115421 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.115589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.115835 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.116569 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.116735 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.116892 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.117042 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.117191 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.117345 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.117612 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.118104 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.118260 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.118514 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.118514 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.118954 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.119153 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.119304 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.119488 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.119715 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.119868 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.120046 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.120210 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.120363 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.120533 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.120678 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.120827 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.121130 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.121281 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.121436 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.121585 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.121733 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.121883 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.122035 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.122177 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.122318 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.122459 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.122621 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830787-2-iscsi {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.122777 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.122931 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.123232 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.123491 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.123669 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.123831 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.123983 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.124135 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.124291 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.124441 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.124684 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.124861 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.125152 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.125411 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.125575 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.125720 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.125963 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.126122 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.126282 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.126431 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.126574 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.126723 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.126865 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.127020 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.127183 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.127334 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.127484 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.127676 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.127942 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.128150 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.128305 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.128447 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.128683 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.128930 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.129315 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.129466 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.129628 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.129779 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.129977 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.130129 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.130319 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.130607 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.130607 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.130888 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.131030 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.131246 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.131402 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.131551 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.131750 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.131902 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.131999 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.132099 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.132194 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.132286 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.132376 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.132466 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.132561 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.132655 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.132738 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.132814 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.132883 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.132965 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.133050 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.133133 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.133220 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.133308 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.133391 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.133497 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.133589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.133589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.133746 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.133827 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.133907 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.133993 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.134092 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.134296 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.134412 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.134498 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.134586 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.134743 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.134949 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.134949 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.135294 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.135294 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.135480 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.135575 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.135674 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.135758 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.135838 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.135954 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.136039 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.136130 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.136225 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.136321 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.136414 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.136502 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.136596 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.136684 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.136767 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.136855 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.136944 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.137036 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.137177 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.137333 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.137518 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.137681 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.137837 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.138007 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.138187 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.138289 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.138505 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.138599 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.138827 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.138918 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.139168 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.139258 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.139474 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.139564 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.139816 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.139923 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.140137 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.140228 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.140450 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.140549 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.140765 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.140870 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.141081 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.141171 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.141399 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.141500 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.141714 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.141821 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.142030 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.142128 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.142347 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.142437 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.142661 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.142758 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.142974 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.143064 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.143287 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.143386 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.143608 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.143714 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.143963 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.144063 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.144281 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.144369 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.144604 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.144702 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.144922 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.145014 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.145240 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.145339 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.145572 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.145684 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.145889 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.145980 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.146207 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.146318 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.146536 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.146627 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.146852 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.146951 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.147168 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.147268 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.147486 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.147583 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.147829 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.147934 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.148149 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.148252 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.148478 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.148569 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.148788 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.148883 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.149106 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.149198 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.149424 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.149513 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.149740 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.149844 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.150577 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.150738 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.150889 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.151034 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.151206 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.151315 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.151519 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.151608 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.151879 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.151984 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.152194 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.152292 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.152509 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.152606 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.152821 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.152911 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.153146 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.153245 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.153476 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.153568 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.153796 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.153894 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.154119 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.154292 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.154417 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.154531 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.154751 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:54:44.154918 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.155105 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.155518 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.155831 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.156068 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.156159 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.156410 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.156507 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.156739 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.156822 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.157072 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.157162 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.157398 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.157558 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.157723 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.157813 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.158059 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.158140 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.158387 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.158489 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.158704 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.158785 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.159760 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.159937 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.160291 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.160458 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.160610 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.160769 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.160916 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.161069 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.161237 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.161473 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.161567 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.161655 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.161791 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.161896 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.161995 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.162079 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.162161 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.162249 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.162339 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.162431 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.162513 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.162601 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.162694 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.162775 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.163009 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.163111 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.163340 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.163427 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.163685 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.163772 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.164410 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.164490 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.164560 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.164650 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.164722 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.164791 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.164958 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.165059 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.165404 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.165518 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.165673 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.166296 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.166703 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.166813 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.166969 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.167063 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.167182 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.167290 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.167508 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.167600 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.168338 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.168575 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.168664 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.168747 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.168838 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.168931 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.169022 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.169116 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.169225 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.169322 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.169575 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.169683 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.169783 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.169877 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.170064 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.170283 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.170377 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.170461 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.170703 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.170805 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.171015 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.171114 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.171335 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.171443 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.171724 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.171843 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.171981 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.172081 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.172298 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.172403 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.172614 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.172713 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.172933 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.173053 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.173316 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.173483 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.173627 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.173770 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.173915 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.174059 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.174211 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.174371 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.174518 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.174656 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.174816 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.174961 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.175125 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.175262 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.175435 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.175571 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.175764 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.175847 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.176085 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.176179 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.176408 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.176508 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.176726 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.176909 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.177045 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.177148 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.177361 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.177463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.177672 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.177777 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.178005 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.178105 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.178582 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.178684 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.178900 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.179022 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.179223 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.179325 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.179542 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.179671 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.179887 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.180017 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.180208 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.180339 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.180528 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.180663 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.180862 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.180997 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.181267 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.181410 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.181663 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.181857 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.182013 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.182187 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.182356 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.182513 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.182683 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.182839 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.182993 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.183164 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.183331 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.183501 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.183678 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.183850 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.183996 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.184176 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.184315 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.184500 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.184631 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.184817 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.184950 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.185160 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.185258 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.185473 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.185572 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.185872 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.186072 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.186183 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.186419 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.186511 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.186748 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.186845 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.187084 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.187176 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.187418 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.187508 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.187758 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.187937 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.188076 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.188243 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.188393 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.188485 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.188707 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.188814 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.189063 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.189177 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.189377 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.189471 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.189709 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.189808 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.190027 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.190122 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.190349 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.190442 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.190667 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.190758 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.190984 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.191089 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.191300 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.191392 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.191622 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.191777 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.191965 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.192074 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.192283 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.192386 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.192601 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.192700 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.192916 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.193018 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.193241 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.193332 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.193553 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.193645 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.193874 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.193981 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.194191 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.194290 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.194513 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.194603 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.194830 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.194930 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.195147 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.195240 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.195465 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.195566 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.195807 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.195903 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.196167 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.196299 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.196487 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.196600 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.196855 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.196975 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.197177 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.197301 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.197502 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.197644 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.197820 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.197967 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.198142 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.198286 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.198465 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.198623 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.198788 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.198942 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.199120 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.199262 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.199440 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.199577 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.199793 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.199926 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.200113 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.200247 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.200446 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.200547 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.200770 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.200861 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.201103 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.201202 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.201415 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.201517 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.201736 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.201836 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.202075 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.202167 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.202404 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.202511 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.202719 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.202819 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.203038 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.203127 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.203356 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.203461 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.203696 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.203792 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.204020 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.204111 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.204340 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.204439 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.204654 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.204745 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.204964 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.205061 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.205281 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.205388 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.205597 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.205702 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.206156 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.206261 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.206358 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.206439 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.206530 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.206622 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.206822 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.206928 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.207137 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.207235 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.207453 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.207544 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.207788 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.207906 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.208109 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.208208 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.208433 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.208589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.208749 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.208849 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.209062 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.209152 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.209385 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.209498 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.209697 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.209798 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.210012 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.210153 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.210330 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.210479 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.210633 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.210773 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.210945 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.211086 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.211257 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.211393 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.211571 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.211750 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.211920 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.212069 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.212241 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.212392 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.213079 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.213257 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.213531 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.213679 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.213853 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.214001 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.214172 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.214350 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.214483 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.214652 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.214799 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.214946 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.215083 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.215227 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.215420 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.215561 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.215770 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.215898 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.216089 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.216180 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.216456 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.216558 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.216719 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.216887 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.217079 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.217171 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.217399 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.217508 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.217732 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.217844 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.218050 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.218142 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.218373 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.218471 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.218694 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.218786 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.219007 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.219105 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.219328 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.219427 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.219669 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.219778 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.219993 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.220251 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.220393 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.220595 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.220754 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.220925 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.221079 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.221247 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.221387 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.221565 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.221716 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.221892 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.222026 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.222211 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.222357 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.222537 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.222640 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.222870 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.222963 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.223219 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.223359 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.223525 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.223622 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.223862 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.223953 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.224179 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.224272 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.224497 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.224596 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.224810 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.224908 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.225124 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.225241 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.225442 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.225537 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.225761 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.225878 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.226074 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.226174 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.226390 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.226481 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.226706 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.226814 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.227020 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.227112 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.227337 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.227435 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.227667 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.227810 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.227989 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.228205 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.228386 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.228517 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.228724 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.228830 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.229047 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.229148 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.229360 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.229450 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.229675 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.229770 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.229989 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.230093 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.230314 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.230419 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.230630 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.230780 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.230980 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.231079 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.231320 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.231420 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.231693 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.231789 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.232013 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.232113 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.232333 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.232506 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.232653 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.232793 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.232967 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.233119 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.233266 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.233503 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.233657 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.233798 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.233949 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.234097 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.234271 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.234427 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.234576 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.234716 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.234856 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.235002 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.235149 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.235299 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.235451 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.235598 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.235777 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.235916 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.236032 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.236202 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.236349 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.236518 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.236661 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.236834 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.236987 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.237151 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.237306 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.237492 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.237651 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.237812 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.237984 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.238150 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.238295 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.238524 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.238664 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.238836 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.238993 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.239155 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.239297 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.239454 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.239604 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.239790 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.239944 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.240087 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.240253 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.240380 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.240595 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.240718 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.240928 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.241021 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.241267 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.241359 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.241586 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.241690 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.241914 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.242007 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.242231 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.242327 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.242547 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.242661 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.242857 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.242956 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.243173 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.243265 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.243487 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.243593 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.244359 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.244458 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.244682 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.244776 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.245016 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.245120 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.245342 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.245441 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.245656 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.245746 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.245978 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.246082 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.246294 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.246417 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.246609 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.246748 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.246928 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.247091 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.247243 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.247408 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.247592 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.247737 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.247832 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.248060 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.248161 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.248382 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.248475 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.248702 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.248794 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.249019 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.249118 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.249353 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.249446 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.249671 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.249772 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.249986 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.250089 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.250297 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.250398 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.250616 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.250732 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.250935 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.251091 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.251252 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.251360 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.251588 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.251709 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.251931 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.252033 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.252262 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.252361 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.252589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.252744 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.252911 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.253057 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.253236 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.253393 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.253539 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.253677 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.253865 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.254006 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.254185 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.254346 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.254505 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.254650 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.254795 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.254934 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.255104 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.255258 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.255433 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.255574 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.255782 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.255876 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.256103 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.256204 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.256436 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.256527 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.256769 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.256869 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.257090 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.257183 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.257404 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.257495 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.257723 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.257822 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.258043 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.258140 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.258360 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.258452 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.258679 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.258779 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.258999 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.259103 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.259380 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.259543 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.259767 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.259900 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.260052 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.260211 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.260369 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.260471 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.260699 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.260791 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.261007 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.261094 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.261324 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.261435 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.261640 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.261733 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.261956 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.262049 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.262292 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.262393 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.262610 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.262715 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.262944 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.263035 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.263262 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.263364 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.263575 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.263707 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.263925 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.264024 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.264238 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.264348 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.264594 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.264686 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.264910 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.265010 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.265257 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.265349 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.265587 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.265681 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.265914 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.266004 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.266239 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.266351 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.266560 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.266653 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.266885 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.266989 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.267203 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.267306 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.267527 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.267614 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.267885 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.267978 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.268298 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.268402 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.268540 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.268631 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.268868 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.268975 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.269179 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.269266 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.269500 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.269599 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.269827 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.269934 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.270142 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.270233 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.270459 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.270550 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.270775 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.271003 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.271101 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.271353 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.271481 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.271709 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.271809 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.272041 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.272179 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.272371 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.272504 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.272701 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.272823 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.273033 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.273252 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.273359 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.273573 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.273681 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.273895 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.273988 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.274230 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.274322 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.274565 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.274656 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.274946 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.275120 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.275303 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.275478 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.275697 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.276031 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.276137 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.276372 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.276477 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.276706 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.276798 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.277031 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.277166 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.277377 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.277497 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.277664 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.277768 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.278004 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.278120 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.278337 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.278493 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.278664 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.278778 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.279000 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.279100 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.279333 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.279433 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.279680 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.279848 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.280008 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.280176 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.280336 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.280513 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.280665 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.280851 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.280991 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.281169 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.281316 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.281488 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.281643 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.281809 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.281969 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.282125 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.282306 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.282439 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.282659 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.282773 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.283000 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.283101 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.283326 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.283428 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.283671 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.283767 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.284005 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.284096 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.284341 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.284543 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.284658 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.284873 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.284994 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.285220 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.285327 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.285561 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.285663 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.285902 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.285994 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.286233 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.286391 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.286589 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.286718 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.286891 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.286984 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.287213 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.287312 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.287530 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.287662 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.287869 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.287965 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.288221 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.288347 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.288608 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.288704 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.288837 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.288973 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.289159 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.289274 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.289475 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.289595 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.289812 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.289915 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.290133 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.290238 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.290455 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.291228 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.291389 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.291723 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.291881 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.292048 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.292197 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.292371 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.292522 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.292710 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.292867 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.293029 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.293174 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.293331 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.293424 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.293650 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.293759 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.293966 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.294067 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.294281 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.294373 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.294596 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.294756 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.294917 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.295030 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.295232 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.295344 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.295545 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.295685 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.295883 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.295993 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.296206 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.296312 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.296527 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.296618 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.296851 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.296953 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.297167 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.297266 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.297486 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.297651 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.297803 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.297946 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.298087 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.298248 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.298400 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.298550 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.298729 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.298871 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.299042 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.299177 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.299351 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.299494 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.299691 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.299788 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.300010 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.300119 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.300335 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.300437 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.300651 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.300745 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.300973 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.301079 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.301376 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.301491 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.301605 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.301680 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.301920 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.302112 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.302241 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.302336 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.302563 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.302656 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.302888 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.302995 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.303474 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.303581 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.303824 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.303918 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.304149 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.304250 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.304473 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.304567 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.304808 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.305015 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.305117 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.305357 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.305451 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.305682 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.305774 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.306004 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.306110 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.306530 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.306869 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.306969 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.307201 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.307293 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.307529 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.307659 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.307878 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.307973 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.308205 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.308320 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.308531 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.308651 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.308874 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.309044 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.309194 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.309340 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.309511 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.309615 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.309836 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.309938 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.310161 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.310339 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.310485 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.310578 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.310806 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.310899 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.311128 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.311230 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.311452 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.311560 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.311800 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.311905 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.312118 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.312230 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.312440 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.312541 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.312761 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.312863 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.313081 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.313174 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.313402 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.313501 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.313722 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.313823 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.314046 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.314146 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.314372 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.314472 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.314693 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.314794 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.315014 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.315106 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.315336 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.315427 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.315678 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.315788 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.316004 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.316103 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.316325 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.316417 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.316648 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.316741 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.316977 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.317078 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.317295 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.317381 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.317622 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.317721 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.317940 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.318156 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.318368 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.318468 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.318694 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.318814 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.319025 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.319151 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.319359 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.319489 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.319712 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.319841 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.320047 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.320173 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.320381 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.320514 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.320705 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.320831 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.321040 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.321130 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.321364 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.321485 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.321708 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.322389 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.322632 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.322722 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.322915 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.323027 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.323236 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.323350 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.323555 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.323735 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.323900 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.323994 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.324220 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.324310 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.324540 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.324770 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.324876 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.325135 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.325292 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.325471 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.325573 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.325795 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.325896 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.326118 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.326211 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.326439 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.326539 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.326758 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.326859 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.327075 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.327177 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.327393 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.327497 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.327735 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.327830 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.328050 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.328154 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.328371 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.328473 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.328687 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.328783 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.329002 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.329094 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.329317 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.329408 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.329635 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.329737 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.329950 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.330041 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.330264 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.330365 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.330580 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.330672 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.330894 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.330988 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.331209 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.331319 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.331524 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.331617 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.331866 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.331959 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.332187 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.332293 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.332503 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.332597 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.332820 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.332913 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.333136 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.333246 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.333451 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.333581 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.333777 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.333870 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.334093 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.334187 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.334412 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.334519 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.334727 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.335074 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.335171 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.335257 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.335348 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.335432 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.335671 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.335780 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.336040 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.336140 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.336364 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.336457 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.336679 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.336820 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.336999 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.337117 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.337324 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.338017 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.338214 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.338319 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.338553 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.338645 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.338870 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.338969 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.339191 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.339292 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.339523 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.339690 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.339885 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.339979 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.340215 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.340431 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.340525 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.340780 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.340882 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.341117 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.341287 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.341463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.341555 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.341807 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.341951 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.342122 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.342237 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.342440 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.342534 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.342759 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.342863 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.343088 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.343258 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.343404 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.343545 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.343790 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.343928 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.344081 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.344234 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.344385 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.344527 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.344669 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.344817 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.344976 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.345124 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.345272 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.345437 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.345582 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.345779 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.345930 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.346108 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.346252 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.346435 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.346572 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.346757 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.346907 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.347050 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 13:54:44.347199 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.347451 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.347807 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.348139 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.348467 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.348797 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.349120 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.349443 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.349765 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.350087 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.350413 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.350753 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.351079 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.351395 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.351853 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.352184 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.352512 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.352846 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.353248 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.353702 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.354053 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.354379 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.354714 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.355038 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.355380 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.355754 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.356098 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.356437 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.356757 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.357077 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.357399 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.357719 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.358050 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.358371 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.358690 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.359006 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.359327 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.359663 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.359984 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.360302 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.360618 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.360938 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.361255 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.361570 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.361882 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.362203 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.362515 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.362831 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.363149 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.363466 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.363815 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.364131 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.364447 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.364763 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.365475 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.366123 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.366476 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.366820 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.367138 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.367479 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.367841 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.368184 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.368508 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.368907 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.369369 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.369717 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.370063 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.370268 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_db.sqlalchemy.engines [None req-f6e19f72-bf5f-424e-a29a-494dca74c54a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:54:44.370393 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.370685 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.371021 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.371332 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.371673 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.372018 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.372362 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.372681 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.373017 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.373348 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.373685 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.374015 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.374340 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.374832 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.375164 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.375486 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.375840 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.376166 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.376490 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.376820 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.377146 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.377529 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.377832 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.378172 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.378576 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.378871 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.379255 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.379557 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.379924 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.380255 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.380578 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.383013 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:54:44.383013 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 13:54:44.405127 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_db.sqlalchemy.engines [None req-944a17a8-0d90-495c-a11c-feaccf2babdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:54:44.435957 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.context [None req-f6e19f72-bf5f-424e-a29a-494dca74c54a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a3c738a4-30d8-4063-acdb-1d2725038730(cell1) {{(pid=116942) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 13:54:44.440373 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6e19f72-bf5f-424e-a29a-494dca74c54a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:54:44.441982 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6e19f72-bf5f-424e-a29a-494dca74c54a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:54:44.442804 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6e19f72-bf5f-424e-a29a-494dca74c54a None None] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:54:44.444815 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6e19f72-bf5f-424e-a29a-494dca74c54a None None] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:54:44.456422 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_db.sqlalchemy.engines [None req-f6e19f72-bf5f-424e-a29a-494dca74c54a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:54:44.457791 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_db.sqlalchemy.engines [None req-f6e19f72-bf5f-424e-a29a-494dca74c54a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:54:44.469679 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.context [None req-944a17a8-0d90-495c-a11c-feaccf2babdf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a3c738a4-30d8-4063-acdb-1d2725038730(cell1) {{(pid=116941) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 13:54:44.474106 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-944a17a8-0d90-495c-a11c-feaccf2babdf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:54:44.475728 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-944a17a8-0d90-495c-a11c-feaccf2babdf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:54:44.476552 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-944a17a8-0d90-495c-a11c-feaccf2babdf None None] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:54:44.478603 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-944a17a8-0d90-495c-a11c-feaccf2babdf None None] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:54:44.489616 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_db.sqlalchemy.engines [None req-944a17a8-0d90-495c-a11c-feaccf2babdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:54:44.490848 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_db.sqlalchemy.engines [None req-944a17a8-0d90-495c-a11c-feaccf2babdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:54:44.617257 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_db.sqlalchemy.engines [None req-f6e19f72-bf5f-424e-a29a-494dca74c54a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:54:44.651189 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_db.sqlalchemy.engines [None req-944a17a8-0d90-495c-a11c-feaccf2babdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:54:45.062600 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: WARNING keystonemiddleware.auth_token [None req-f6e19f72-bf5f-424e-a29a-494dca74c54a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 13:54:45.069462 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: WARNING keystonemiddleware.auth_token [None req-f6e19f72-bf5f-424e-a29a-494dca74c54a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 13:54:45.093104 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: WARNING keystonemiddleware.auth_token [None req-944a17a8-0d90-495c-a11c-feaccf2babdf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 13:54:45.099686 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: WARNING keystonemiddleware.auth_token [None req-944a17a8-0d90-495c-a11c-feaccf2babdf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 13:54:45.297886 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: WARNING keystonemiddleware.auth_token [None req-f6e19f72-bf5f-424e-a29a-494dca74c54a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 13:54:45.303476 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: WARNING keystonemiddleware.auth_token [None req-f6e19f72-bf5f-424e-a29a-494dca74c54a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 13:54:45.309112 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f69dd769c0 pid: 116942 (default app) Apr 11 13:54:45.329753 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: WARNING keystonemiddleware.auth_token [None req-944a17a8-0d90-495c-a11c-feaccf2babdf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 13:54:45.335037 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: WARNING keystonemiddleware.auth_token [None req-944a17a8-0d90-495c-a11c-feaccf2babdf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 13:54:45.341214 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f69dd769c0 pid: 116941 (default app) Apr 11 13:55:28.009435 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-791702a0-69ca-4678-8ef5-54aac142a3db tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] Action: 'create', calling method: .version_select at 0x7f73088cb9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-334971785", "metadata": {"Type": "work"}}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:55:28.014412 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-791702a0-69ca-4678-8ef5-54aac142a3db tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:55:28.023257 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-791702a0-69ca-4678-8ef5-54aac142a3db tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.453381 Apr 11 13:55:28.024152 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1155 bytes} [Mon Apr 11 13:55:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1459 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 11 13:55:28.037782 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7eba980a-ecba-4128-84ac-7c3ee77596f0 tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] Action: 'create', calling method: .version_select at 0x7f730883e790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-582434631", "metadata": {"Type": "work"}}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:55:28.051544 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7eba980a-ecba-4128-84ac-7c3ee77596f0 tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:55:28.054372 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7eba980a-ecba-4128-84ac-7c3ee77596f0 tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022761 Apr 11 13:55:28.054963 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 2/2] 10.222.0.67 () {60 vars in 1155 bytes} [Mon Apr 11 13:55:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 11 13:55:28.096612 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1c7b2797-b7ad-44be-a202-11a6a3960825 tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] Action: 'create', calling method: .version_select at 0x7f73088cbe50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-50094941", "metadata": {"Type": "work"}}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:55:28.099000 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1c7b2797-b7ad-44be-a202-11a6a3960825 tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:55:28.101950 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1c7b2797-b7ad-44be-a202-11a6a3960825 tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015664 Apr 11 13:55:28.102532 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 3/3] 10.222.0.67 () {60 vars in 1155 bytes} [Mon Apr 11 13:55:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 13:55:28.113542 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d0aef59e-b4b6-45d2-a0c5-8f2eb62aeaca tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] Calling method '.version_select at 0x7f7308820430>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:28.786795 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1329283310", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "networks": [{"uuid": "0b070dcc-e109-4e7e-bd96-aa5b9a4a9fce"}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:55:29.278636 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-d0aef59e-b4b6-45d2-a0c5-8f2eb62aeaca tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] HTTP exception thrown: Volume tempest-invalid-43476050 could not be found. Apr 11 13:55:29.279362 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d0aef59e-b4b6-45d2-a0c5-8f2eb62aeaca tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] Returning 404 to user: Volume tempest-invalid-43476050 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:55:29.280292 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d0aef59e-b4b6-45d2-a0c5-8f2eb62aeaca tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-43476050" status: 404 len: 97 microversion: 2.1 time: 1.171548 Apr 11 13:55:29.284857 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 4/4] 10.222.0.67 () {58 vars in 1211 bytes} [Mon Apr 11 13:55:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-43476050 => generated 97 bytes in 1177 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 11 13:55:29.293317 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f81a67bb-9e56-4d92-a375-ae823f327f39 tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007071 Apr 11 13:55:29.304089 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 5/5] 10.222.0.67 () {58 vars in 1139 bytes} [Mon Apr 11 13:55:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 13:55:29.309317 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-22c69f93-2dec-459d-9836-a7f9b495c02e tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003739 Apr 11 13:55:29.331982 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 6/6] 10.222.0.67 () {58 vars in 1136 bytes} [Mon Apr 11 13:55:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 13:55:29.337148 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-134f47d2-056e-4d1e-8227-9cc68e57440b tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] Calling method '.version_select at 0x7f73087b4e50>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:29.383210 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-134f47d2-056e-4d1e-8227-9cc68e57440b tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] HTTP exception thrown: Volume 7f2d0b8c-7dca-497e-83ba-3e35e34a248f could not be found. Apr 11 13:55:29.384015 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-134f47d2-056e-4d1e-8227-9cc68e57440b tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] Returning 404 to user: Volume 7f2d0b8c-7dca-497e-83ba-3e35e34a248f could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:55:29.384838 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-134f47d2-056e-4d1e-8227-9cc68e57440b tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/7f2d0b8c-7dca-497e-83ba-3e35e34a248f" status: 404 len: 109 microversion: 2.1 time: 0.051593 Apr 11 13:55:29.389487 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 7/7] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Apr 11 13:55:29 2022] DELETE /compute/v2.1/os-volumes/7f2d0b8c-7dca-497e-83ba-3e35e34a248f => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 13:55:29.394588 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4cce404f-36cd-4c32-a6c4-bc808badee29 tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] Calling method '.version_select at 0x7f73087b4790>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:29.513002 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-4cce404f-36cd-4c32-a6c4-bc808badee29 tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] HTTP exception thrown: Volume b7a09a42-e47a-411d-a85c-97d2afac3e6a could not be found. Apr 11 13:55:29.514140 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4cce404f-36cd-4c32-a6c4-bc808badee29 tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] Returning 404 to user: Volume b7a09a42-e47a-411d-a85c-97d2afac3e6a could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:55:29.515121 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4cce404f-36cd-4c32-a6c4-bc808badee29 tempest-VolumesNegativeTest-173550781 tempest-VolumesNegativeTest-173550781-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/b7a09a42-e47a-411d-a85c-97d2afac3e6a" status: 404 len: 109 microversion: 2.1 time: 0.124415 Apr 11 13:55:29.516139 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 8/8] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 13:55:29 2022] GET /compute/v2.1/os-volumes/b7a09a42-e47a-411d-a85c-97d2afac3e6a => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 13:55:29.661116 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8c8b286c-9cea-42f7-b27b-aba628f7f4cd tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] Calling method '.version_select at 0x7f73087b4a60>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:29.760782 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] validate_networks() for [('0b070dcc-e109-4e7e-bd96-aa5b9a4a9fce', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 13:55:29.940102 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8c8b286c-9cea-42f7-b27b-aba628f7f4cd tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d514b35d-d8ae-45fd-bb68-0099f4822b04" status: 200 len: 351 microversion: 2.1 time: 0.283318 Apr 11 13:55:29.941100 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 9/9] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 13:55:29 2022] GET /compute/v2.1/os-volumes/d514b35d-d8ae-45fd-bb68-0099f4822b04 => generated 351 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 13:55:32.071247 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 13:55:32.071842 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 13:55:32.072709 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 13:55:32.073177 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 13:55:32.073769 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 13:55:32.114083 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:32.119860 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:32.121172 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b5a7efbf-9007-4a80-afba-1047e8bb0a66 tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] Calling method '.version_select at 0x7f7308743040>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:32.124492 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:32.126087 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:32.315569 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b5a7efbf-9007-4a80-afba-1047e8bb0a66 tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/66aade73-d01c-4e2d-9695-c49ca96a9d93" status: 200 len: 351 microversion: 2.1 time: 0.198376 Apr 11 13:55:32.316271 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 10/10] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 13:55:32 2022] GET /compute/v2.1/os-volumes/66aade73-d01c-4e2d-9695-c49ca96a9d93 => generated 351 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 13:55:32.317532 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Getting quotas for project 93aa1a74c2fc48ce81fde5490e3604bf. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:55:32.354589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Getting quotas for user 6b10dd2bce99432abf55a8d348cf1ad9 and project 93aa1a74c2fc48ce81fde5490e3604bf. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:55:32.405268 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 13:55:32.409238 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 13:55:32.580180 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0db6e922-9abc-4e98-a5b1-f701074ed09a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.321500 Apr 11 13:55:32.587799 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 1/11] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 13:55:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 5332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 11 13:55:32.592523 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-494232b8-19c2-459c-9c11-d15b86a47b95 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:32.593390 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-494232b8-19c2-459c-9c11-d15b86a47b95 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:33.072680 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-494232b8-19c2-459c-9c11-d15b86a47b95 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:33.103449 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-494232b8-19c2-459c-9c11-d15b86a47b95 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1215 microversion: 2.1 time: 0.514841 Apr 11 13:55:33.120054 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 11/12] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:32 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1215 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:55:34.138134 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5a230782-aeb5-4572-8cf4-4989f8691e2e tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:34.138783 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5a230782-aeb5-4572-8cf4-4989f8691e2e tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:34.342111 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5a230782-aeb5-4572-8cf4-4989f8691e2e tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:34.360811 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5a230782-aeb5-4572-8cf4-4989f8691e2e tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1215 microversion: 2.1 time: 0.226782 Apr 11 13:55:34.372408 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 2/13] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:34 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:34.633480 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f9631530-bba4-40b5-930b-23aa7b6f1e9a tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] Calling method '.version_select at 0x7f73087b4310>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:34.906014 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f9631530-bba4-40b5-930b-23aa7b6f1e9a tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/8648705d-bed2-4fc3-8e7c-8e15e9c00f30" status: 200 len: 351 microversion: 2.1 time: 0.278111 Apr 11 13:55:34.907029 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 12/14] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 13:55:34 2022] GET /compute/v2.1/os-volumes/8648705d-bed2-4fc3-8e7c-8e15e9c00f30 => generated 351 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:55:34.925093 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0e18854b-2e0f-4204-9573-b6f862f9427f tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] Calling method '.version_select at 0x7f7307eec040>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:35.284321 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0e18854b-2e0f-4204-9573-b6f862f9427f tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.369119 Apr 11 13:55:35.285963 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 3/15] 10.222.0.67 () {58 vars in 1133 bytes} [Mon Apr 11 13:55:34 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:35.305577 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a781200a-f331-43c5-be92-da67e8abe076 tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] Calling method '.version_select at 0x7f73087600d0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:35.385851 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c38331e0-9994-4363-aeaf-88e72a7ca991 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:35.386487 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c38331e0-9994-4363-aeaf-88e72a7ca991 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:35.396132 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c38331e0-9994-4363-aeaf-88e72a7ca991 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:35.400859 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c38331e0-9994-4363-aeaf-88e72a7ca991 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:35.402656 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c38331e0-9994-4363-aeaf-88e72a7ca991 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:35.403845 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c38331e0-9994-4363-aeaf-88e72a7ca991 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:35.505073 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a781200a-f331-43c5-be92-da67e8abe076 tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.209242 Apr 11 13:55:35.505643 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 13/16] 10.222.0.67 () {58 vars in 1148 bytes} [Mon Apr 11 13:55:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:55:35.522146 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-463a498f-c6b1-4d3b-91cc-2f564460b686 tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] Calling method '.version_select at 0x7f7308703040>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:35.635299 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-463a498f-c6b1-4d3b-91cc-2f564460b686 tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.118955 Apr 11 13:55:35.635917 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 14/17] 10.222.0.67 () {58 vars in 1133 bytes} [Mon Apr 11 13:55:35 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:35.649971 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d2b2b4d8-e381-47e2-8abe-9c0c7d3a073a tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] Calling method '.version_select at 0x7f7308743670>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:35.738177 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c38331e0-9994-4363-aeaf-88e72a7ca991 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:35.760774 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c38331e0-9994-4363-aeaf-88e72a7ca991 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1219 microversion: 2.1 time: 0.386287 Apr 11 13:55:35.766599 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 4/18] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:35 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1219 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:55:35.884457 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d2b2b4d8-e381-47e2-8abe-9c0c7d3a073a tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.241238 Apr 11 13:55:35.884947 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 15/19] 10.222.0.67 () {58 vars in 1166 bytes} [Mon Apr 11 13:55:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 13:55:35.901630 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f2b3f4eb-12a6-4911-a050-eeba44186ebf tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] Calling method '.version_select at 0x7f73075dbf70>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:36.023588 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f2b3f4eb-12a6-4911-a050-eeba44186ebf tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.130512 Apr 11 13:55:36.024856 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 5/20] 10.222.0.67 () {58 vars in 1169 bytes} [Mon Apr 11 13:55:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:55:36.036359 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-694bc363-75e0-49f0-9636-4ecf5f93aaf4 tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] Calling method '.version_select at 0x7f7308760ca0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:36.201043 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-694bc363-75e0-49f0-9636-4ecf5f93aaf4 tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.168336 Apr 11 13:55:36.202056 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 16/21] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Apr 11 13:55:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:36.213649 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-dfc06a92-85b4-4941-9fe7-59950e993895 tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] Calling method '.version_select at 0x7f73075eadc0>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:36.423968 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-dfc06a92-85b4-4941-9fe7-59950e993895 tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.214799 Apr 11 13:55:36.425686 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 6/22] 10.222.0.67 () {58 vars in 1187 bytes} [Mon Apr 11 13:55:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:55:36.440598 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-69937b2a-3f2c-4fc2-abce-5c31df94a78d tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] Calling method '.version_select at 0x7f7308703550>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:36.597661 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-69937b2a-3f2c-4fc2-abce-5c31df94a78d tempest-VolumesTestJSON-95387095 tempest-VolumesTestJSON-95387095-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.163887 Apr 11 13:55:36.598645 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 17/23] 10.222.0.67 () {58 vars in 1154 bytes} [Mon Apr 11 13:55:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:55:36.778828 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-efdd5fd1-c169-46af-b35c-9493e06bbb0c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:36.779526 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-efdd5fd1-c169-46af-b35c-9493e06bbb0c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:36.796797 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-efdd5fd1-c169-46af-b35c-9493e06bbb0c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:36.797479 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-efdd5fd1-c169-46af-b35c-9493e06bbb0c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:36.798484 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-efdd5fd1-c169-46af-b35c-9493e06bbb0c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:36.801350 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-efdd5fd1-c169-46af-b35c-9493e06bbb0c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:37.090356 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-efdd5fd1-c169-46af-b35c-9493e06bbb0c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:37.100284 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-efdd5fd1-c169-46af-b35c-9493e06bbb0c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1219 microversion: 2.1 time: 0.325280 Apr 11 13:55:37.100855 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 7/24] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:36 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1219 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:55:38.026239 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-871048914", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:55:38.118248 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-641b5fa3-2b05-4d58-a92d-b6956df8c80f tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:38.118894 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-641b5fa3-2b05-4d58-a92d-b6956df8c80f tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:38.131748 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-641b5fa3-2b05-4d58-a92d-b6956df8c80f tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:38.132425 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-641b5fa3-2b05-4d58-a92d-b6956df8c80f tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:38.133634 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-641b5fa3-2b05-4d58-a92d-b6956df8c80f tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:38.136237 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-641b5fa3-2b05-4d58-a92d-b6956df8c80f tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:38.285333 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-641b5fa3-2b05-4d58-a92d-b6956df8c80f tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:38.292148 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] validate_networks() for [('5b366c5b-a29e-42a6-8ecc-0cc9ff2fdbc0', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 13:55:38.306315 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-641b5fa3-2b05-4d58-a92d-b6956df8c80f tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1211 microversion: 2.1 time: 0.192658 Apr 11 13:55:38.314942 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 8/25] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:38 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1211 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:39.331445 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-af4bacb8-2793-4f27-8def-753dcef84efa tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:39.333097 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-af4bacb8-2793-4f27-8def-753dcef84efa tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:39.348010 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-af4bacb8-2793-4f27-8def-753dcef84efa tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:39.348365 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-af4bacb8-2793-4f27-8def-753dcef84efa tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:39.349188 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-af4bacb8-2793-4f27-8def-753dcef84efa tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:39.350155 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-af4bacb8-2793-4f27-8def-753dcef84efa tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:39.516127 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-af4bacb8-2793-4f27-8def-753dcef84efa tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:39.524949 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-af4bacb8-2793-4f27-8def-753dcef84efa tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1267 microversion: 2.1 time: 0.197299 Apr 11 13:55:39.541570 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 9/26] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:39 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:55:39.829127 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-71223701-9acd-45d3-9770-6a5be902ba7b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Action: 'create', calling method: .version_select at 0x7f7307577160>, body: {"keypair": {"name": "tempest-keypair-1738121521"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:55:40.048843 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 13:55:40.049319 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 13:55:40.049737 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 13:55:40.050149 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 13:55:40.050816 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 13:55:40.082468 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:40.082919 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:40.084490 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:40.085047 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:40.147089 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-71223701-9acd-45d3-9770-6a5be902ba7b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Getting quotas for project a8a28d94e79a4972b0f8f61ab1cb1490. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:55:40.158289 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Getting quotas for project 7e9487af89de4df6b7592a993fc4827e. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:55:40.159818 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-71223701-9acd-45d3-9770-6a5be902ba7b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Getting quotas for user 539174103f414528829d033481b83b0d and project a8a28d94e79a4972b0f8f61ab1cb1490. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:55:40.173794 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Getting quotas for user cfe3f01cd2f742f4903ed97da6b6923c and project 7e9487af89de4df6b7592a993fc4827e. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:55:40.199690 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 13:55:40.202468 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 13:55:40.398373 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9e935cbd-ff68-43d2-9109-7b0b3e88fc46 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.877306 Apr 11 13:55:40.404949 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 18/27] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 13:55:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 13:55:40.419114 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b804768c-3a0f-4eff-8cbc-a6cb76a4a9dd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:40.423250 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b804768c-3a0f-4eff-8cbc-a6cb76a4a9dd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:40.558730 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b804768c-3a0f-4eff-8cbc-a6cb76a4a9dd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:40.585420 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b804768c-3a0f-4eff-8cbc-a6cb76a4a9dd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1221 microversion: 2.1 time: 0.179129 Apr 11 13:55:40.588974 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 19/28] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:40 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1221 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:40.595790 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0e201b76-83d4-4449-aa2a-042c60d09406 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:40.609287 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0e201b76-83d4-4449-aa2a-042c60d09406 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:40.640882 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e201b76-83d4-4449-aa2a-042c60d09406 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:40.641784 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e201b76-83d4-4449-aa2a-042c60d09406 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:40.643573 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e201b76-83d4-4449-aa2a-042c60d09406 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:40.644226 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e201b76-83d4-4449-aa2a-042c60d09406 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:40.976851 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-71223701-9acd-45d3-9770-6a5be902ba7b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Getting quotas for project a8a28d94e79a4972b0f8f61ab1cb1490. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:55:40.995171 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-71223701-9acd-45d3-9770-6a5be902ba7b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Getting quotas for user 539174103f414528829d033481b83b0d and project a8a28d94e79a4972b0f8f61ab1cb1490. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:55:41.029163 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-71223701-9acd-45d3-9770-6a5be902ba7b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.392364 Apr 11 13:55:41.032119 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 10/29] 10.222.0.67 () {62 vars in 1198 bytes} [Mon Apr 11 13:55:39 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1396 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 11 13:55:41.058429 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-863802688", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:55:41.125929 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0e201b76-83d4-4449-aa2a-042c60d09406 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:41.179033 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0e201b76-83d4-4449-aa2a-042c60d09406 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1275 microversion: 2.1 time: 0.588692 Apr 11 13:55:41.201740 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 20/30] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:40 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1275 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:41.221537 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] validate_networks() for [('5b366c5b-a29e-42a6-8ecc-0cc9ff2fdbc0', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 13:55:42.218696 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-23e3a04e-38c9-4884-8042-1f50f49bab7a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:42.220038 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-23e3a04e-38c9-4884-8042-1f50f49bab7a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:42.229715 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23e3a04e-38c9-4884-8042-1f50f49bab7a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:42.232289 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23e3a04e-38c9-4884-8042-1f50f49bab7a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:42.234539 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23e3a04e-38c9-4884-8042-1f50f49bab7a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:42.236773 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23e3a04e-38c9-4884-8042-1f50f49bab7a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:43.092110 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 13:55:43.092827 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 13:55:43.093424 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 13:55:43.094170 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 13:55:43.094787 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 13:55:43.124301 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:43.126280 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:43.131029 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-23e3a04e-38c9-4884-8042-1f50f49bab7a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:43.134077 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:43.137227 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:43.149672 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-23e3a04e-38c9-4884-8042-1f50f49bab7a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1273 microversion: 2.1 time: 0.931229 Apr 11 13:55:43.164305 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 21/31] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:42 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1273 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:43.207859 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Getting quotas for project 7e9487af89de4df6b7592a993fc4827e. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:55:43.220777 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Getting quotas for user cfe3f01cd2f742f4903ed97da6b6923c and project 7e9487af89de4df6b7592a993fc4827e. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:55:43.266785 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 13:55:43.273548 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 13:55:43.430603 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2e0ccd82-898e-41f6-8ba2-4ae4d688b73c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.380834 Apr 11 13:55:43.431869 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 11/32] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 13:55:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 13:55:43.453083 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c798b408-54c2-4b17-978e-5c5727a98d3f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:43.456772 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c798b408-54c2-4b17-978e-5c5727a98d3f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:43.657535 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c798b408-54c2-4b17-978e-5c5727a98d3f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:43.665773 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c798b408-54c2-4b17-978e-5c5727a98d3f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1221 microversion: 2.1 time: 0.227662 Apr 11 13:55:43.678514 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 22/33] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:43 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1221 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:44.168790 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-64c75cc7-a3e6-45d9-98d9-2948461757c8 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:44.169594 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-64c75cc7-a3e6-45d9-98d9-2948461757c8 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:44.183122 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-64c75cc7-a3e6-45d9-98d9-2948461757c8 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:44.183582 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-64c75cc7-a3e6-45d9-98d9-2948461757c8 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:44.184399 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-64c75cc7-a3e6-45d9-98d9-2948461757c8 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:44.184838 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-64c75cc7-a3e6-45d9-98d9-2948461757c8 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:44.525142 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-64c75cc7-a3e6-45d9-98d9-2948461757c8 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:44.533293 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-64c75cc7-a3e6-45d9-98d9-2948461757c8 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.368242 Apr 11 13:55:44.533774 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 12/34] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:44 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:44.688596 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-eeea13df-f4eb-444f-a7ae-f9991b5d8169 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:44.690744 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-eeea13df-f4eb-444f-a7ae-f9991b5d8169 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:44.701395 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eeea13df-f4eb-444f-a7ae-f9991b5d8169 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:44.702108 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eeea13df-f4eb-444f-a7ae-f9991b5d8169 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:44.703099 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eeea13df-f4eb-444f-a7ae-f9991b5d8169 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:44.704667 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eeea13df-f4eb-444f-a7ae-f9991b5d8169 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:44.815038 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-eeea13df-f4eb-444f-a7ae-f9991b5d8169 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:44.823602 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-eeea13df-f4eb-444f-a7ae-f9991b5d8169 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1225 microversion: 2.1 time: 0.141352 Apr 11 13:55:44.824662 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 23/35] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:44 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:45.340980 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1730386009", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0208f136-78bf-40a4-90c8-9a7151bfb362"}], "security_groups": [{"name": "tempest-securitygroup--795783263"}], "key_name": "tempest-keypair-1738121521", "user_data": "}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:55:45.517481 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] validate_networks() for [('0208f136-78bf-40a4-90c8-9a7151bfb362', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 13:55:45.553143 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fd045360-3dd9-48e7-b201-0c94dc95babc tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:45.554127 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fd045360-3dd9-48e7-b201-0c94dc95babc tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:45.565298 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fd045360-3dd9-48e7-b201-0c94dc95babc tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:45.573834 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fd045360-3dd9-48e7-b201-0c94dc95babc tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:45.575004 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fd045360-3dd9-48e7-b201-0c94dc95babc tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:45.575661 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fd045360-3dd9-48e7-b201-0c94dc95babc tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:45.883887 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fd045360-3dd9-48e7-b201-0c94dc95babc tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:45.893259 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fd045360-3dd9-48e7-b201-0c94dc95babc tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.346126 Apr 11 13:55:45.894663 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 24/36] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:45 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:45.907959 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ac6a729c-9218-464b-8d72-058e0b952fad tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:45.908905 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ac6a729c-9218-464b-8d72-058e0b952fad tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:45.917565 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac6a729c-9218-464b-8d72-058e0b952fad tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:45.918139 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac6a729c-9218-464b-8d72-058e0b952fad tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:45.919097 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac6a729c-9218-464b-8d72-058e0b952fad tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:45.919877 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac6a729c-9218-464b-8d72-058e0b952fad tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:46.036795 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ac6a729c-9218-464b-8d72-058e0b952fad tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:46.050410 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ac6a729c-9218-464b-8d72-058e0b952fad tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1225 microversion: 2.1 time: 0.149395 Apr 11 13:55:46.056542 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 25/37] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:45 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1225 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:46.407653 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 13:55:46.408961 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 13:55:46.410563 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 13:55:46.412528 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 13:55:46.413191 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 13:55:46.437520 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:46.438152 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:46.438979 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:46.439419 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:46.481794 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Getting quotas for project a8a28d94e79a4972b0f8f61ab1cb1490. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:55:46.493120 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Getting quotas for user 539174103f414528829d033481b83b0d and project a8a28d94e79a4972b0f8f61ab1cb1490. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:55:46.516606 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 13:55:46.519688 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 13:55:46.660465 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-dcdfd47f-2834-4c78-a364-f38e7bb52723 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.323977 Apr 11 13:55:46.663667 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 13/38] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Apr 11 13:55:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 11 13:55:46.681101 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-540d4680-38ba-4be3-baf6-7df72b2ae36f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:46.682695 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-540d4680-38ba-4be3-baf6-7df72b2ae36f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:46.843750 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-540d4680-38ba-4be3-baf6-7df72b2ae36f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:46.857609 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-540d4680-38ba-4be3-baf6-7df72b2ae36f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:46.862498 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-540d4680-38ba-4be3-baf6-7df72b2ae36f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:46.868275 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-540d4680-38ba-4be3-baf6-7df72b2ae36f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1282 microversion: 2.20 time: 0.199662 Apr 11 13:55:46.870387 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 26/39] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:55:46 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1282 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:55:46.914457 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b46f806a-4fb6-41f0-987a-23886d802799 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:46.915874 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b46f806a-4fb6-41f0-987a-23886d802799 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:46.931405 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b46f806a-4fb6-41f0-987a-23886d802799 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:46.937321 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b46f806a-4fb6-41f0-987a-23886d802799 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:46.938429 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b46f806a-4fb6-41f0-987a-23886d802799 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:46.943176 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b46f806a-4fb6-41f0-987a-23886d802799 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:47.085618 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2c1ec87d-1c53-4638-b55f-351907bc8663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:47.086321 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2c1ec87d-1c53-4638-b55f-351907bc8663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:47.105877 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2c1ec87d-1c53-4638-b55f-351907bc8663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:47.109078 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2c1ec87d-1c53-4638-b55f-351907bc8663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:47.113192 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2c1ec87d-1c53-4638-b55f-351907bc8663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:47.115561 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2c1ec87d-1c53-4638-b55f-351907bc8663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:47.251923 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b46f806a-4fb6-41f0-987a-23886d802799 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:47.262989 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b46f806a-4fb6-41f0-987a-23886d802799 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.355110 Apr 11 13:55:47.263935 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 14/40] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:46 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:47.551476 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2c1ec87d-1c53-4638-b55f-351907bc8663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:47.570519 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2c1ec87d-1c53-4638-b55f-351907bc8663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1225 microversion: 2.1 time: 0.495798 Apr 11 13:55:47.576403 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 27/41] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:47 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1225 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:55:47.900214 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ec4e0ee8-29ad-41e8-be53-4d9a4f0998af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:47.902514 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ec4e0ee8-29ad-41e8-be53-4d9a4f0998af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:47.925702 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ec4e0ee8-29ad-41e8-be53-4d9a4f0998af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:47.929461 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ec4e0ee8-29ad-41e8-be53-4d9a4f0998af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:47.934620 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ec4e0ee8-29ad-41e8-be53-4d9a4f0998af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:47.938892 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ec4e0ee8-29ad-41e8-be53-4d9a4f0998af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:48.172654 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ec4e0ee8-29ad-41e8-be53-4d9a4f0998af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:48.201514 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ec4e0ee8-29ad-41e8-be53-4d9a4f0998af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:48.219542 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ec4e0ee8-29ad-41e8-be53-4d9a4f0998af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:48.221286 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ec4e0ee8-29ad-41e8-be53-4d9a4f0998af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1286 microversion: 2.20 time: 0.337891 Apr 11 13:55:48.224232 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 15/42] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:55:47 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1286 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:55:48.287304 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-62fbdab4-6a88-44ab-b9c6-be77e2d4a62c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:48.288280 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-62fbdab4-6a88-44ab-b9c6-be77e2d4a62c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:48.303913 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-62fbdab4-6a88-44ab-b9c6-be77e2d4a62c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:48.305502 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-62fbdab4-6a88-44ab-b9c6-be77e2d4a62c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:48.308297 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-62fbdab4-6a88-44ab-b9c6-be77e2d4a62c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:48.309987 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-62fbdab4-6a88-44ab-b9c6-be77e2d4a62c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:48.593620 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c9bc1320-8dff-4339-9ee9-3b84a7615129 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:48.594467 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c9bc1320-8dff-4339-9ee9-3b84a7615129 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:48.613880 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9bc1320-8dff-4339-9ee9-3b84a7615129 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:48.616777 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9bc1320-8dff-4339-9ee9-3b84a7615129 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:48.617751 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9bc1320-8dff-4339-9ee9-3b84a7615129 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:48.620593 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9bc1320-8dff-4339-9ee9-3b84a7615129 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:48.828873 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c9bc1320-8dff-4339-9ee9-3b84a7615129 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:48.835492 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c9bc1320-8dff-4339-9ee9-3b84a7615129 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1273 microversion: 2.1 time: 0.245870 Apr 11 13:55:48.846271 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 16/43] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:48 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:49.241206 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-02f257fe-d4f4-457f-a5bf-09e0af73497a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:49.241870 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-02f257fe-d4f4-457f-a5bf-09e0af73497a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:49.255210 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02f257fe-d4f4-457f-a5bf-09e0af73497a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:49.255712 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02f257fe-d4f4-457f-a5bf-09e0af73497a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:49.256518 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02f257fe-d4f4-457f-a5bf-09e0af73497a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:49.256966 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02f257fe-d4f4-457f-a5bf-09e0af73497a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:49.526241 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-02f257fe-d4f4-457f-a5bf-09e0af73497a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:49.541493 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-02f257fe-d4f4-457f-a5bf-09e0af73497a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:49.547295 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-02f257fe-d4f4-457f-a5bf-09e0af73497a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:49.551691 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-02f257fe-d4f4-457f-a5bf-09e0af73497a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1334 microversion: 2.20 time: 0.314552 Apr 11 13:55:49.557711 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 17/44] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:55:49 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1334 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:55:49.715154 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-62fbdab4-6a88-44ab-b9c6-be77e2d4a62c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:49.730280 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-62fbdab4-6a88-44ab-b9c6-be77e2d4a62c tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 1.453533 Apr 11 13:55:49.748970 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 28/45] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:48 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:49.852855 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-032f002a-3956-40fd-9356-72a6e19c2e52 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:49.853880 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-032f002a-3956-40fd-9356-72a6e19c2e52 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:49.861144 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-032f002a-3956-40fd-9356-72a6e19c2e52 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:49.862106 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-032f002a-3956-40fd-9356-72a6e19c2e52 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:49.870035 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-032f002a-3956-40fd-9356-72a6e19c2e52 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:49.870914 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-032f002a-3956-40fd-9356-72a6e19c2e52 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:50.072388 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-032f002a-3956-40fd-9356-72a6e19c2e52 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:50.081768 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-032f002a-3956-40fd-9356-72a6e19c2e52 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1291 microversion: 2.1 time: 0.232685 Apr 11 13:55:50.087035 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 18/46] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:49 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1291 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:50.576918 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0aff03a1-fb06-4c3a-b846-12b6c7ec71da tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:50.577897 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0aff03a1-fb06-4c3a-b846-12b6c7ec71da tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:50.589672 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0aff03a1-fb06-4c3a-b846-12b6c7ec71da tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:50.598133 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0aff03a1-fb06-4c3a-b846-12b6c7ec71da tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:50.600083 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0aff03a1-fb06-4c3a-b846-12b6c7ec71da tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:50.607916 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0aff03a1-fb06-4c3a-b846-12b6c7ec71da tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:50.754190 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-980b7834-c312-4c8c-8844-34e8148faa51 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:50.756524 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-980b7834-c312-4c8c-8844-34e8148faa51 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:50.770443 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-980b7834-c312-4c8c-8844-34e8148faa51 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:50.776587 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-980b7834-c312-4c8c-8844-34e8148faa51 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:50.777769 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-980b7834-c312-4c8c-8844-34e8148faa51 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:50.779741 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-980b7834-c312-4c8c-8844-34e8148faa51 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:51.041269 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0aff03a1-fb06-4c3a-b846-12b6c7ec71da tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:51.057523 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0aff03a1-fb06-4c3a-b846-12b6c7ec71da tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:51.065655 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0aff03a1-fb06-4c3a-b846-12b6c7ec71da tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:51.070803 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0aff03a1-fb06-4c3a-b846-12b6c7ec71da tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1352 microversion: 2.20 time: 0.497855 Apr 11 13:55:51.079358 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 29/47] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:55:50 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1352 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:55:51.103480 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ff13734c-6133-4ca7-9630-a3a1ab04e956 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:51.104565 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ff13734c-6133-4ca7-9630-a3a1ab04e956 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:51.127300 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff13734c-6133-4ca7-9630-a3a1ab04e956 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:51.133712 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff13734c-6133-4ca7-9630-a3a1ab04e956 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:51.137795 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff13734c-6133-4ca7-9630-a3a1ab04e956 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:51.138388 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff13734c-6133-4ca7-9630-a3a1ab04e956 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:51.241615 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-980b7834-c312-4c8c-8844-34e8148faa51 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:51.254936 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-980b7834-c312-4c8c-8844-34e8148faa51 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.505851 Apr 11 13:55:51.258220 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 19/48] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:50 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:51.595960 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ff13734c-6133-4ca7-9630-a3a1ab04e956 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:51.612273 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ff13734c-6133-4ca7-9630-a3a1ab04e956 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1279 microversion: 2.1 time: 0.513086 Apr 11 13:55:51.614634 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 30/49] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:51 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1279 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:52.101825 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-00f6fbb1-97e5-4069-901b-3ef6754d642c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:52.102905 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-00f6fbb1-97e5-4069-901b-3ef6754d642c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:52.135420 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-00f6fbb1-97e5-4069-901b-3ef6754d642c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:52.135987 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-00f6fbb1-97e5-4069-901b-3ef6754d642c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:52.146634 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-00f6fbb1-97e5-4069-901b-3ef6754d642c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:52.147238 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-00f6fbb1-97e5-4069-901b-3ef6754d642c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:52.273750 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d02afe39-8c1c-43af-b15c-c393b59ac963 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:52.275365 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d02afe39-8c1c-43af-b15c-c393b59ac963 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:52.305897 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d02afe39-8c1c-43af-b15c-c393b59ac963 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:52.308532 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d02afe39-8c1c-43af-b15c-c393b59ac963 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:52.310120 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d02afe39-8c1c-43af-b15c-c393b59ac963 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:52.313518 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d02afe39-8c1c-43af-b15c-c393b59ac963 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:53.102119 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-00f6fbb1-97e5-4069-901b-3ef6754d642c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:53.130931 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-00f6fbb1-97e5-4069-901b-3ef6754d642c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:53.139246 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-00f6fbb1-97e5-4069-901b-3ef6754d642c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:53.140526 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-00f6fbb1-97e5-4069-901b-3ef6754d642c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 1.045999 Apr 11 13:55:53.141268 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 20/50] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:55:52 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:55:53.160185 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e404ef32-8f34-4410-acf3-19d9d16ef779 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:53.170026 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e404ef32-8f34-4410-acf3-19d9d16ef779 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:53.188742 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e404ef32-8f34-4410-acf3-19d9d16ef779 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:53.196318 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e404ef32-8f34-4410-acf3-19d9d16ef779 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:53.197163 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e404ef32-8f34-4410-acf3-19d9d16ef779 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:53.197608 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e404ef32-8f34-4410-acf3-19d9d16ef779 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:53.443401 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d02afe39-8c1c-43af-b15c-c393b59ac963 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:53.465535 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d02afe39-8c1c-43af-b15c-c393b59ac963 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 1.197441 Apr 11 13:55:53.466747 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 31/51] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:52 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:55:53.724633 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-2251e443-6d4b-4bab-89ca-478435157e7e req-08f12d23-0c92-4ade-8b2e-f43cf9817c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c0e150-9739-490b-84c2-340a7275b92a", "tag": "9cd033d6-9a4d-4a1a-af53-9a6b9c9c2e71"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:55:53.746633 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-2251e443-6d4b-4bab-89ca-478435157e7e req-08f12d23-0c92-4ade-8b2e-f43cf9817c14 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:53.748246 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-2251e443-6d4b-4bab-89ca-478435157e7e req-08f12d23-0c92-4ade-8b2e-f43cf9817c14 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:53.794495 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-2251e443-6d4b-4bab-89ca-478435157e7e req-08f12d23-0c92-4ade-8b2e-f43cf9817c14 service nova] Creating event network-changed:9cd033d6-9a4d-4a1a-af53-9a6b9c9c2e71 for instance f2c0e150-9739-490b-84c2-340a7275b92a on hv-cinder-83078 Apr 11 13:55:53.797723 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-2251e443-6d4b-4bab-89ca-478435157e7e req-08f12d23-0c92-4ade-8b2e-f43cf9817c14 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 11 13:55:53.799403 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3b226c70-56ac-44c2-8ee1-cb1dfba0488c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:53.805099 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3b226c70-56ac-44c2-8ee1-cb1dfba0488c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:53.806243 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3b226c70-56ac-44c2-8ee1-cb1dfba0488c None None] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:53.806999 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3b226c70-56ac-44c2-8ee1-cb1dfba0488c None None] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:53.849432 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.compute.rpcapi [None req-3b226c70-56ac-44c2-8ee1-cb1dfba0488c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 11 13:55:53.852986 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3b226c70-56ac-44c2-8ee1-cb1dfba0488c None None] Releasing lock "compute-rpcapi-router" {{(pid=116942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 13:55:53.899389 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3b226c70-56ac-44c2-8ee1-cb1dfba0488c None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.431002 Apr 11 13:55:53.901282 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 32/52] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:55:54.090104 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e404ef32-8f34-4410-acf3-19d9d16ef779 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:54.101080 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e404ef32-8f34-4410-acf3-19d9d16ef779 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1321 microversion: 2.1 time: 0.952112 Apr 11 13:55:54.120438 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 21/53] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:53 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1321 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:54.163872 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b52f544a-a594-481d-baec-81c09813e1f5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:54.164902 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b52f544a-a594-481d-baec-81c09813e1f5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:54.191662 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b52f544a-a594-481d-baec-81c09813e1f5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:54.193071 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b52f544a-a594-481d-baec-81c09813e1f5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:54.194090 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b52f544a-a594-481d-baec-81c09813e1f5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:54.194762 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b52f544a-a594-481d-baec-81c09813e1f5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:54.492724 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b57f65c0-df98-49d6-91c0-b25a8103d7ca tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:54.493740 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b57f65c0-df98-49d6-91c0-b25a8103d7ca tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:54.522306 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b57f65c0-df98-49d6-91c0-b25a8103d7ca tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:54.525441 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b57f65c0-df98-49d6-91c0-b25a8103d7ca tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:54.528559 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b57f65c0-df98-49d6-91c0-b25a8103d7ca tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:54.530828 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b57f65c0-df98-49d6-91c0-b25a8103d7ca tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:55.170505 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b57f65c0-df98-49d6-91c0-b25a8103d7ca tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:55.204356 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b57f65c0-df98-49d6-91c0-b25a8103d7ca tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.713460 Apr 11 13:55:55.230624 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 22/54] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:54 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:55.259323 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-610892ed-4a33-492b-9cec-d31dd18da4f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:55.262821 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-610892ed-4a33-492b-9cec-d31dd18da4f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:55.275062 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-610892ed-4a33-492b-9cec-d31dd18da4f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:55.282227 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-610892ed-4a33-492b-9cec-d31dd18da4f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:55.284747 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-610892ed-4a33-492b-9cec-d31dd18da4f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:55.288481 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-610892ed-4a33-492b-9cec-d31dd18da4f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:55.354913 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b52f544a-a594-481d-baec-81c09813e1f5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:55.363186 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b52f544a-a594-481d-baec-81c09813e1f5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:55.392896 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b52f544a-a594-481d-baec-81c09813e1f5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:55.394084 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b52f544a-a594-481d-baec-81c09813e1f5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 1.235980 Apr 11 13:55:55.412484 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 33/55] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:55:54 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:55:55.937999 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-610892ed-4a33-492b-9cec-d31dd18da4f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:55.968472 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-610892ed-4a33-492b-9cec-d31dd18da4f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1321 microversion: 2.1 time: 0.735760 Apr 11 13:55:55.979295 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 23/56] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:55 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1321 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:56.243571 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-42107e80-cfaf-4b4c-a263-4f8570a165fb tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:56.244980 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-42107e80-cfaf-4b4c-a263-4f8570a165fb tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:56.286079 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-42107e80-cfaf-4b4c-a263-4f8570a165fb tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:56.292365 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-42107e80-cfaf-4b4c-a263-4f8570a165fb tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:56.295022 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-42107e80-cfaf-4b4c-a263-4f8570a165fb tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:56.296869 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-42107e80-cfaf-4b4c-a263-4f8570a165fb tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:56.428917 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4c0668f8-aad6-4e04-9b07-fffac7df210e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:56.434736 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4c0668f8-aad6-4e04-9b07-fffac7df210e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:56.472531 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c0668f8-aad6-4e04-9b07-fffac7df210e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:56.473475 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c0668f8-aad6-4e04-9b07-fffac7df210e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:56.476715 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c0668f8-aad6-4e04-9b07-fffac7df210e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:56.480115 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c0668f8-aad6-4e04-9b07-fffac7df210e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:56.989269 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4c0668f8-aad6-4e04-9b07-fffac7df210e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:56.998299 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4c0668f8-aad6-4e04-9b07-fffac7df210e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:57.002563 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4c0668f8-aad6-4e04-9b07-fffac7df210e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:57.019278 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4c0668f8-aad6-4e04-9b07-fffac7df210e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 0.610425 Apr 11 13:55:57.024881 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 24/57] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:55:56 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:55:57.050811 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-24868c5f-a129-48b1-9869-8088bb8144e7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:57.054145 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-24868c5f-a129-48b1-9869-8088bb8144e7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:57.071094 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24868c5f-a129-48b1-9869-8088bb8144e7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:57.071648 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24868c5f-a129-48b1-9869-8088bb8144e7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:57.072486 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24868c5f-a129-48b1-9869-8088bb8144e7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:57.072924 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24868c5f-a129-48b1-9869-8088bb8144e7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:57.439259 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-24868c5f-a129-48b1-9869-8088bb8144e7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:57.448137 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-24868c5f-a129-48b1-9869-8088bb8144e7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1321 microversion: 2.1 time: 0.421698 Apr 11 13:55:57.449046 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 25/58] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:57 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:57.460813 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-42107e80-cfaf-4b4c-a263-4f8570a165fb tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:57.476653 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-42107e80-cfaf-4b4c-a263-4f8570a165fb tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 1.243011 Apr 11 13:55:57.486123 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 34/59] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:56 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:57.781331 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-4205527d-8026-4603-8072-240e7d8bc2ad req-06c0013c-5f1a-4b86-9228-1cf49ab4455f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5f3b7d-8b92-4264-b41a-1d1ade879f2f", "tag": "cda04f4a-80ef-4c18-b575-cb87293272ce"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:55:57.804013 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-4205527d-8026-4603-8072-240e7d8bc2ad req-06c0013c-5f1a-4b86-9228-1cf49ab4455f service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:57.804457 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-4205527d-8026-4603-8072-240e7d8bc2ad req-06c0013c-5f1a-4b86-9228-1cf49ab4455f service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:57.830507 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-4205527d-8026-4603-8072-240e7d8bc2ad req-06c0013c-5f1a-4b86-9228-1cf49ab4455f service nova] Creating event network-changed:cda04f4a-80ef-4c18-b575-cb87293272ce for instance 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f on hv-cinder-83078 Apr 11 13:55:57.831050 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-4205527d-8026-4603-8072-240e7d8bc2ad req-06c0013c-5f1a-4b86-9228-1cf49ab4455f service nova] Acquired lock "compute-rpcapi-router" {{(pid=116941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 11 13:55:57.834200 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2bb55a58-f0cd-4f2f-94fa-8c9f42620021 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:57.834653 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2bb55a58-f0cd-4f2f-94fa-8c9f42620021 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:57.835620 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2bb55a58-f0cd-4f2f-94fa-8c9f42620021 None None] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:57.836239 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2bb55a58-f0cd-4f2f-94fa-8c9f42620021 None None] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:57.846435 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.compute.rpcapi [None req-2bb55a58-f0cd-4f2f-94fa-8c9f42620021 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 11 13:55:57.849365 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2bb55a58-f0cd-4f2f-94fa-8c9f42620021 None None] Releasing lock "compute-rpcapi-router" {{(pid=116941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 13:55:57.875086 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2bb55a58-f0cd-4f2f-94fa-8c9f42620021 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.424703 Apr 11 13:55:57.884523 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 26/60] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:55:57.907265 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-e1e7d9d5-3938-4263-a6e7-3f749daf0e9a req-e8b58cef-50a2-4576-95ac-9ce7c5700d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea0ff31-35c2-4763-bf7a-6d0aada0558c", "tag": "b53ccbb2-cadf-467b-980a-34cb619111ad"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:55:57.924071 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-e1e7d9d5-3938-4263-a6e7-3f749daf0e9a req-e8b58cef-50a2-4576-95ac-9ce7c5700d33 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:57.925449 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-e1e7d9d5-3938-4263-a6e7-3f749daf0e9a req-e8b58cef-50a2-4576-95ac-9ce7c5700d33 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:57.944576 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-e1e7d9d5-3938-4263-a6e7-3f749daf0e9a req-e8b58cef-50a2-4576-95ac-9ce7c5700d33 service nova] Creating event network-changed:b53ccbb2-cadf-467b-980a-34cb619111ad for instance eea0ff31-35c2-4763-bf7a-6d0aada0558c on hv-cinder-83078 Apr 11 13:55:57.950871 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-e1e7d9d5-3938-4263-a6e7-3f749daf0e9a req-e8b58cef-50a2-4576-95ac-9ce7c5700d33 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047020 Apr 11 13:55:57.952175 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 35/61] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:55:58.045236 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-15e4a1f2-e632-426f-b442-5b6cf69a440b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:58.046237 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-15e4a1f2-e632-426f-b442-5b6cf69a440b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:58.078468 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15e4a1f2-e632-426f-b442-5b6cf69a440b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:58.079370 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15e4a1f2-e632-426f-b442-5b6cf69a440b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:58.082848 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15e4a1f2-e632-426f-b442-5b6cf69a440b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:58.084765 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15e4a1f2-e632-426f-b442-5b6cf69a440b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:58.466425 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-43b124f5-695e-48f6-8595-a654dec3de56 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:58.467235 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-43b124f5-695e-48f6-8595-a654dec3de56 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:58.477697 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-43b124f5-695e-48f6-8595-a654dec3de56 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:58.480210 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-43b124f5-695e-48f6-8595-a654dec3de56 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:58.484110 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-43b124f5-695e-48f6-8595-a654dec3de56 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:58.484734 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-43b124f5-695e-48f6-8595-a654dec3de56 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:58.748663 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-15e4a1f2-e632-426f-b442-5b6cf69a440b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:58.775841 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-15e4a1f2-e632-426f-b442-5b6cf69a440b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:58.778158 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-15e4a1f2-e632-426f-b442-5b6cf69a440b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:58.786214 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-15e4a1f2-e632-426f-b442-5b6cf69a440b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 0.743338 Apr 11 13:55:58.787298 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 27/62] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:55:58 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:55:58.799514 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-23d90ecb-e1ab-4e0b-8ff2-dc442dbe2a0d tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:58.800173 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-23d90ecb-e1ab-4e0b-8ff2-dc442dbe2a0d tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:58.826390 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-23d90ecb-e1ab-4e0b-8ff2-dc442dbe2a0d tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:58.830173 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-23d90ecb-e1ab-4e0b-8ff2-dc442dbe2a0d tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:58.836090 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-23d90ecb-e1ab-4e0b-8ff2-dc442dbe2a0d tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:58.838307 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-23d90ecb-e1ab-4e0b-8ff2-dc442dbe2a0d tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:59.102932 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-23d90ecb-e1ab-4e0b-8ff2-dc442dbe2a0d tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:59.113510 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-23d90ecb-e1ab-4e0b-8ff2-dc442dbe2a0d tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.321792 Apr 11 13:55:59.124995 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 28/63] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:58 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:55:59.370189 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-43b124f5-695e-48f6-8595-a654dec3de56 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:55:59.399903 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-43b124f5-695e-48f6-8595-a654dec3de56 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1321 microversion: 2.1 time: 0.939407 Apr 11 13:55:59.401461 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 36/64] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:55:58 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1321 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:55:59.810188 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-aa6ad417-dd8d-4b04-bccf-71b782584324 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:55:59.813345 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-aa6ad417-dd8d-4b04-bccf-71b782584324 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:55:59.824258 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aa6ad417-dd8d-4b04-bccf-71b782584324 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:59.825073 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aa6ad417-dd8d-4b04-bccf-71b782584324 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:59.826780 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aa6ad417-dd8d-4b04-bccf-71b782584324 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:59.828377 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aa6ad417-dd8d-4b04-bccf-71b782584324 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:55:59.984212 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-19e97e64-16d8-426a-92c2-c1dd36b41d58 req-bad59d74-ae30-4d52-8e96-aacf499e9314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6e921e1-7746-446b-bad6-d7188f8bdac2", "tag": "41becb52-f1e7-4c33-ad5e-faa52141b7c9"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:55:59.994624 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-19e97e64-16d8-426a-92c2-c1dd36b41d58 req-bad59d74-ae30-4d52-8e96-aacf499e9314 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:55:59.995073 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-19e97e64-16d8-426a-92c2-c1dd36b41d58 req-bad59d74-ae30-4d52-8e96-aacf499e9314 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:00.006661 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-19e97e64-16d8-426a-92c2-c1dd36b41d58 req-bad59d74-ae30-4d52-8e96-aacf499e9314 service nova] Creating event network-changed:41becb52-f1e7-4c33-ad5e-faa52141b7c9 for instance a6e921e1-7746-446b-bad6-d7188f8bdac2 on hv-cinder-83078 Apr 11 13:56:00.011822 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-19e97e64-16d8-426a-92c2-c1dd36b41d58 req-bad59d74-ae30-4d52-8e96-aacf499e9314 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031471 Apr 11 13:56:00.012929 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 37/65] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 13:56:00.134991 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e6435bda-c232-4a37-bf6e-403c7c79c51b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:00.135748 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e6435bda-c232-4a37-bf6e-403c7c79c51b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:00.177050 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e6435bda-c232-4a37-bf6e-403c7c79c51b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:00.180889 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e6435bda-c232-4a37-bf6e-403c7c79c51b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:00.186009 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e6435bda-c232-4a37-bf6e-403c7c79c51b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:00.186513 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e6435bda-c232-4a37-bf6e-403c7c79c51b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:00.249500 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-aa6ad417-dd8d-4b04-bccf-71b782584324 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:00.260369 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-aa6ad417-dd8d-4b04-bccf-71b782584324 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:00.263236 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-aa6ad417-dd8d-4b04-bccf-71b782584324 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:00.265429 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-aa6ad417-dd8d-4b04-bccf-71b782584324 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 0.461053 Apr 11 13:56:00.278673 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 29/66] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:55:59 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:56:00.417484 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8df4ae49-fee5-4211-b257-049cc40b42f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:00.418361 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8df4ae49-fee5-4211-b257-049cc40b42f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:00.425265 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8df4ae49-fee5-4211-b257-049cc40b42f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:00.425711 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8df4ae49-fee5-4211-b257-049cc40b42f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:00.427467 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8df4ae49-fee5-4211-b257-049cc40b42f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:00.428091 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8df4ae49-fee5-4211-b257-049cc40b42f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:00.664945 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8df4ae49-fee5-4211-b257-049cc40b42f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:00.672581 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8df4ae49-fee5-4211-b257-049cc40b42f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1321 microversion: 2.1 time: 0.258817 Apr 11 13:56:00.676544 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 30/67] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:00 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:00.883305 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e6435bda-c232-4a37-bf6e-403c7c79c51b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:00.892419 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e6435bda-c232-4a37-bf6e-403c7c79c51b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.765563 Apr 11 13:56:00.903493 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 38/68] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:00 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:01.287656 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-832fa63e-8222-4aee-b7d1-6526462c36de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:01.288855 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-832fa63e-8222-4aee-b7d1-6526462c36de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:01.298825 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-832fa63e-8222-4aee-b7d1-6526462c36de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:01.299909 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-832fa63e-8222-4aee-b7d1-6526462c36de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:01.301746 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-832fa63e-8222-4aee-b7d1-6526462c36de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:01.302395 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-832fa63e-8222-4aee-b7d1-6526462c36de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:01.488330 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-832fa63e-8222-4aee-b7d1-6526462c36de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:01.505303 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-832fa63e-8222-4aee-b7d1-6526462c36de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:01.506875 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-832fa63e-8222-4aee-b7d1-6526462c36de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:01.508069 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-832fa63e-8222-4aee-b7d1-6526462c36de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 0.225795 Apr 11 13:56:01.530158 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 31/69] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:56:01 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:56:01.696602 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ccf0b21d-a4b9-4c33-a18c-82dbeee8cb18 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:01.697344 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ccf0b21d-a4b9-4c33-a18c-82dbeee8cb18 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:01.708462 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ccf0b21d-a4b9-4c33-a18c-82dbeee8cb18 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:01.708913 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ccf0b21d-a4b9-4c33-a18c-82dbeee8cb18 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:01.711569 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ccf0b21d-a4b9-4c33-a18c-82dbeee8cb18 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:01.713698 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ccf0b21d-a4b9-4c33-a18c-82dbeee8cb18 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:01.912252 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f0247c97-d66a-4207-9942-495e6b678d3b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:01.913463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f0247c97-d66a-4207-9942-495e6b678d3b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:01.924339 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f0247c97-d66a-4207-9942-495e6b678d3b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:01.927054 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f0247c97-d66a-4207-9942-495e6b678d3b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:01.929155 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f0247c97-d66a-4207-9942-495e6b678d3b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:01.931178 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f0247c97-d66a-4207-9942-495e6b678d3b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:02.216463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f0247c97-d66a-4207-9942-495e6b678d3b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:02.235828 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f0247c97-d66a-4207-9942-495e6b678d3b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.327557 Apr 11 13:56:02.236483 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 32/70] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:01 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:02.348590 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ccf0b21d-a4b9-4c33-a18c-82dbeee8cb18 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:02.357081 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ccf0b21d-a4b9-4c33-a18c-82dbeee8cb18 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1321 microversion: 2.1 time: 0.670604 Apr 11 13:56:02.357736 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 39/71] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:01 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1321 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:02.501243 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-cdc6af34-ea1c-4861-bea3-a97bf9f7c553 req-665c5a38-941f-4bf3-8731-55bddb45a8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c0e150-9739-490b-84c2-340a7275b92a", "name": "network-vif-plugged", "status": "completed", "tag": "9cd033d6-9a4d-4a1a-af53-9a6b9c9c2e71"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:56:02.517219 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-cdc6af34-ea1c-4861-bea3-a97bf9f7c553 req-665c5a38-941f-4bf3-8731-55bddb45a8c7 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:02.517675 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-cdc6af34-ea1c-4861-bea3-a97bf9f7c553 req-665c5a38-941f-4bf3-8731-55bddb45a8c7 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:02.526412 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6147e35f-f891-4c8b-83f7-fef28f018cf3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:02.526996 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6147e35f-f891-4c8b-83f7-fef28f018cf3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:02.541176 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6147e35f-f891-4c8b-83f7-fef28f018cf3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:02.543548 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6147e35f-f891-4c8b-83f7-fef28f018cf3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:02.544549 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6147e35f-f891-4c8b-83f7-fef28f018cf3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:02.546081 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6147e35f-f891-4c8b-83f7-fef28f018cf3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:02.547836 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-cdc6af34-ea1c-4861-bea3-a97bf9f7c553 req-665c5a38-941f-4bf3-8731-55bddb45a8c7 service nova] Creating event network-vif-plugged:9cd033d6-9a4d-4a1a-af53-9a6b9c9c2e71 for instance f2c0e150-9739-490b-84c2-340a7275b92a on hv-cinder-83078 Apr 11 13:56:02.563580 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-cdc6af34-ea1c-4861-bea3-a97bf9f7c553 req-665c5a38-941f-4bf3-8731-55bddb45a8c7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.322333 Apr 11 13:56:02.565793 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 33/72] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:56:02.745344 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6147e35f-f891-4c8b-83f7-fef28f018cf3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:02.754295 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6147e35f-f891-4c8b-83f7-fef28f018cf3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:02.755821 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6147e35f-f891-4c8b-83f7-fef28f018cf3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:02.757113 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6147e35f-f891-4c8b-83f7-fef28f018cf3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 0.234564 Apr 11 13:56:02.757675 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 40/73] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:56:02 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:56:03.263106 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9ec5040b-6df6-4081-bfa9-0a728fa3a04b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:03.263838 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9ec5040b-6df6-4081-bfa9-0a728fa3a04b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:03.275398 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9ec5040b-6df6-4081-bfa9-0a728fa3a04b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:03.277804 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9ec5040b-6df6-4081-bfa9-0a728fa3a04b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:03.282378 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9ec5040b-6df6-4081-bfa9-0a728fa3a04b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:03.283005 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9ec5040b-6df6-4081-bfa9-0a728fa3a04b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:03.375585 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-88e2aeb4-c095-4c3a-ac7d-b02bbe1b1644 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:03.379870 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-88e2aeb4-c095-4c3a-ac7d-b02bbe1b1644 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:03.397602 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88e2aeb4-c095-4c3a-ac7d-b02bbe1b1644 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:03.400150 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88e2aeb4-c095-4c3a-ac7d-b02bbe1b1644 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:03.401269 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88e2aeb4-c095-4c3a-ac7d-b02bbe1b1644 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:03.405000 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88e2aeb4-c095-4c3a-ac7d-b02bbe1b1644 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:03.554853 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9ec5040b-6df6-4081-bfa9-0a728fa3a04b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:03.563037 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9ec5040b-6df6-4081-bfa9-0a728fa3a04b tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.306016 Apr 11 13:56:03.565083 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 34/74] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:03 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:03.701317 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-88e2aeb4-c095-4c3a-ac7d-b02bbe1b1644 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:03.710654 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-88e2aeb4-c095-4c3a-ac7d-b02bbe1b1644 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1321 microversion: 2.1 time: 0.340189 Apr 11 13:56:03.715698 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 41/75] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:03 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:56:03.777669 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0e7d8cb4-7797-4ae2-9f97-74c2ab92832c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:03.778597 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0e7d8cb4-7797-4ae2-9f97-74c2ab92832c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:03.792625 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e7d8cb4-7797-4ae2-9f97-74c2ab92832c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:03.794112 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e7d8cb4-7797-4ae2-9f97-74c2ab92832c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:03.795440 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e7d8cb4-7797-4ae2-9f97-74c2ab92832c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:03.796266 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e7d8cb4-7797-4ae2-9f97-74c2ab92832c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:04.020265 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0e7d8cb4-7797-4ae2-9f97-74c2ab92832c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:04.032037 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0e7d8cb4-7797-4ae2-9f97-74c2ab92832c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:04.034617 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0e7d8cb4-7797-4ae2-9f97-74c2ab92832c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:04.036592 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0e7d8cb4-7797-4ae2-9f97-74c2ab92832c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 0.264797 Apr 11 13:56:04.038082 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 35/76] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:56:03 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:56:04.584208 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-45a40b4c-14af-4c41-8586-eb9236ebc5c1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:04.585581 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-45a40b4c-14af-4c41-8586-eb9236ebc5c1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:04.592103 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-45a40b4c-14af-4c41-8586-eb9236ebc5c1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:04.592880 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-45a40b4c-14af-4c41-8586-eb9236ebc5c1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:04.593858 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-45a40b4c-14af-4c41-8586-eb9236ebc5c1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:04.594335 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-45a40b4c-14af-4c41-8586-eb9236ebc5c1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:04.618714 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-c80d5bff-1d0c-4396-a39e-52060117f8ee req-228ee7a6-5df7-46aa-a49c-506c6b30c969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e921e1-7746-446b-bad6-d7188f8bdac2", "name": "network-vif-plugged", "status": "completed", "tag": "41becb52-f1e7-4c33-ad5e-faa52141b7c9"}, {"server_uuid": "0d5f3b7d-8b92-4264-b41a-1d1ade879f2f", "name": "network-vif-plugged", "status": "completed", "tag": "cda04f4a-80ef-4c18-b575-cb87293272ce"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:56:04.633843 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c80d5bff-1d0c-4396-a39e-52060117f8ee req-228ee7a6-5df7-46aa-a49c-506c6b30c969 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:04.634286 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c80d5bff-1d0c-4396-a39e-52060117f8ee req-228ee7a6-5df7-46aa-a49c-506c6b30c969 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:04.652429 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-c80d5bff-1d0c-4396-a39e-52060117f8ee req-228ee7a6-5df7-46aa-a49c-506c6b30c969 service nova] Creating event network-vif-plugged:41becb52-f1e7-4c33-ad5e-faa52141b7c9 for instance a6e921e1-7746-446b-bad6-d7188f8bdac2 on hv-cinder-83078 Apr 11 13:56:04.653204 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-c80d5bff-1d0c-4396-a39e-52060117f8ee req-228ee7a6-5df7-46aa-a49c-506c6b30c969 service nova] Creating event network-vif-plugged:cda04f4a-80ef-4c18-b575-cb87293272ce for instance 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f on hv-cinder-83078 Apr 11 13:56:04.665279 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-c80d5bff-1d0c-4396-a39e-52060117f8ee req-228ee7a6-5df7-46aa-a49c-506c6b30c969 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049276 Apr 11 13:56:04.666509 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 36/77] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 13:56:04.730431 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9ab9ec3d-42f0-4ecb-9589-011af9a1663a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:04.731125 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9ab9ec3d-42f0-4ecb-9589-011af9a1663a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:04.737175 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9ab9ec3d-42f0-4ecb-9589-011af9a1663a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:04.737624 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9ab9ec3d-42f0-4ecb-9589-011af9a1663a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:04.738491 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9ab9ec3d-42f0-4ecb-9589-011af9a1663a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:04.738979 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9ab9ec3d-42f0-4ecb-9589-011af9a1663a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:04.753455 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-45a40b4c-14af-4c41-8586-eb9236ebc5c1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:04.760505 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-45a40b4c-14af-4c41-8586-eb9236ebc5c1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.180690 Apr 11 13:56:04.761088 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 42/78] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:04 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:04.873383 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9ab9ec3d-42f0-4ecb-9589-011af9a1663a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:04.880820 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9ab9ec3d-42f0-4ecb-9589-011af9a1663a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1321 microversion: 2.1 time: 0.154456 Apr 11 13:56:04.881455 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 37/79] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:04 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:05.056902 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f6a6e480-a3d2-440b-8151-7dfc0c9cb8c0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:05.057739 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f6a6e480-a3d2-440b-8151-7dfc0c9cb8c0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:05.063886 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6a6e480-a3d2-440b-8151-7dfc0c9cb8c0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:05.064343 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6a6e480-a3d2-440b-8151-7dfc0c9cb8c0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:05.065116 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6a6e480-a3d2-440b-8151-7dfc0c9cb8c0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:05.065557 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6a6e480-a3d2-440b-8151-7dfc0c9cb8c0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:05.202419 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f6a6e480-a3d2-440b-8151-7dfc0c9cb8c0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:05.215034 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f6a6e480-a3d2-440b-8151-7dfc0c9cb8c0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:05.216552 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f6a6e480-a3d2-440b-8151-7dfc0c9cb8c0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:05.217654 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f6a6e480-a3d2-440b-8151-7dfc0c9cb8c0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 0.165901 Apr 11 13:56:05.218495 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 43/80] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:56:05 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:56:05.779731 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-135ddb2b-c0d7-45f5-8635-b54c86edfcd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:05.780287 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-135ddb2b-c0d7-45f5-8635-b54c86edfcd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:05.788142 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-135ddb2b-c0d7-45f5-8635-b54c86edfcd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:05.788592 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-135ddb2b-c0d7-45f5-8635-b54c86edfcd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:05.789361 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-135ddb2b-c0d7-45f5-8635-b54c86edfcd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:05.789797 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-135ddb2b-c0d7-45f5-8635-b54c86edfcd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:05.898477 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b9a274b8-0586-472a-9788-fb7d708a20cf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:05.899785 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b9a274b8-0586-472a-9788-fb7d708a20cf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:05.910920 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9a274b8-0586-472a-9788-fb7d708a20cf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:05.913280 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9a274b8-0586-472a-9788-fb7d708a20cf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:05.914169 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9a274b8-0586-472a-9788-fb7d708a20cf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:05.914805 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9a274b8-0586-472a-9788-fb7d708a20cf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:05.924272 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-135ddb2b-c0d7-45f5-8635-b54c86edfcd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:05.932555 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-135ddb2b-c0d7-45f5-8635-b54c86edfcd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.158484 Apr 11 13:56:05.933128 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 38/81] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:05 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:06.056097 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b9a274b8-0586-472a-9788-fb7d708a20cf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:06.063268 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b9a274b8-0586-472a-9788-fb7d708a20cf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1321 microversion: 2.1 time: 0.169774 Apr 11 13:56:06.063876 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 44/82] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:05 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:06.236000 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f82184bf-fc26-42cd-81fb-cd1e5cc4cfbe tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:06.236611 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f82184bf-fc26-42cd-81fb-cd1e5cc4cfbe tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:06.242732 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f82184bf-fc26-42cd-81fb-cd1e5cc4cfbe tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:06.243176 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f82184bf-fc26-42cd-81fb-cd1e5cc4cfbe tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:06.243987 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f82184bf-fc26-42cd-81fb-cd1e5cc4cfbe tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:06.244420 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f82184bf-fc26-42cd-81fb-cd1e5cc4cfbe tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:06.374952 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f82184bf-fc26-42cd-81fb-cd1e5cc4cfbe tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:06.383397 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f82184bf-fc26-42cd-81fb-cd1e5cc4cfbe tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:06.384951 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f82184bf-fc26-42cd-81fb-cd1e5cc4cfbe tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:06.386069 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f82184bf-fc26-42cd-81fb-cd1e5cc4cfbe tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 0.153944 Apr 11 13:56:06.386640 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 39/83] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:56:06 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:56:06.949963 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-678dc0cc-75d9-4a45-ba8f-2542748efeea tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:06.950581 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-678dc0cc-75d9-4a45-ba8f-2542748efeea tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:06.958161 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-678dc0cc-75d9-4a45-ba8f-2542748efeea tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:06.959191 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-678dc0cc-75d9-4a45-ba8f-2542748efeea tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:06.960729 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-678dc0cc-75d9-4a45-ba8f-2542748efeea tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:06.961487 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-678dc0cc-75d9-4a45-ba8f-2542748efeea tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:07.082838 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f48c58db-0b8b-4cd4-93be-970dc8ad5759 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:07.084145 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f48c58db-0b8b-4cd4-93be-970dc8ad5759 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:07.100308 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f48c58db-0b8b-4cd4-93be-970dc8ad5759 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:07.100769 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f48c58db-0b8b-4cd4-93be-970dc8ad5759 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:07.101533 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f48c58db-0b8b-4cd4-93be-970dc8ad5759 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:07.101960 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f48c58db-0b8b-4cd4-93be-970dc8ad5759 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:07.241322 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-678dc0cc-75d9-4a45-ba8f-2542748efeea tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:07.251696 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-678dc0cc-75d9-4a45-ba8f-2542748efeea tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.305482 Apr 11 13:56:07.262150 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 45/84] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:06 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:07.274514 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f48c58db-0b8b-4cd4-93be-970dc8ad5759 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:07.283179 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f48c58db-0b8b-4cd4-93be-970dc8ad5759 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1321 microversion: 2.1 time: 0.205919 Apr 11 13:56:07.283927 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 40/85] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:07 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:56:07.404556 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-92b80f48-4859-4671-999b-8b9684a4b6b8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:07.405251 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-92b80f48-4859-4671-999b-8b9684a4b6b8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:07.411575 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92b80f48-4859-4671-999b-8b9684a4b6b8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:07.412149 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92b80f48-4859-4671-999b-8b9684a4b6b8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:07.412990 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92b80f48-4859-4671-999b-8b9684a4b6b8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:07.413496 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92b80f48-4859-4671-999b-8b9684a4b6b8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:07.545372 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-92b80f48-4859-4671-999b-8b9684a4b6b8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:07.553609 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-92b80f48-4859-4671-999b-8b9684a4b6b8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:07.555118 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-92b80f48-4859-4671-999b-8b9684a4b6b8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:07.556259 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-92b80f48-4859-4671-999b-8b9684a4b6b8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 0.155784 Apr 11 13:56:07.556860 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 46/86] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:56:07 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:56:08.269141 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0f9a67f2-1970-41d3-904c-02c482d5bec6 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:08.269699 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0f9a67f2-1970-41d3-904c-02c482d5bec6 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:08.283978 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f9a67f2-1970-41d3-904c-02c482d5bec6 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:08.285224 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f9a67f2-1970-41d3-904c-02c482d5bec6 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:08.286308 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f9a67f2-1970-41d3-904c-02c482d5bec6 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:08.286911 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f9a67f2-1970-41d3-904c-02c482d5bec6 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:08.300078 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6f293a38-49c1-4da3-a24b-d620df8abb9d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:08.301538 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6f293a38-49c1-4da3-a24b-d620df8abb9d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:08.312909 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6f293a38-49c1-4da3-a24b-d620df8abb9d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:08.313547 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6f293a38-49c1-4da3-a24b-d620df8abb9d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:08.314341 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6f293a38-49c1-4da3-a24b-d620df8abb9d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:08.314772 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6f293a38-49c1-4da3-a24b-d620df8abb9d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:08.448400 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0f9a67f2-1970-41d3-904c-02c482d5bec6 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:08.457384 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0f9a67f2-1970-41d3-904c-02c482d5bec6 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.191192 Apr 11 13:56:08.459686 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 41/87] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:08 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:08.485956 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6f293a38-49c1-4da3-a24b-d620df8abb9d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:08.494076 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6f293a38-49c1-4da3-a24b-d620df8abb9d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1321 microversion: 2.1 time: 0.197893 Apr 11 13:56:08.503206 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 47/88] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:08 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:56:08.574155 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-975f198b-129a-40b1-b0c7-266a2031c74b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:08.574772 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-975f198b-129a-40b1-b0c7-266a2031c74b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:08.580449 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-975f198b-129a-40b1-b0c7-266a2031c74b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:08.581074 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-975f198b-129a-40b1-b0c7-266a2031c74b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:08.582086 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-975f198b-129a-40b1-b0c7-266a2031c74b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:08.582550 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-975f198b-129a-40b1-b0c7-266a2031c74b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:08.730933 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-975f198b-129a-40b1-b0c7-266a2031c74b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:08.738860 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-975f198b-129a-40b1-b0c7-266a2031c74b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:08.740412 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-975f198b-129a-40b1-b0c7-266a2031c74b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:08.741526 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-975f198b-129a-40b1-b0c7-266a2031c74b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 0.171270 Apr 11 13:56:08.742090 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 42/89] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:56:08 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:56:09.475734 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-885a4289-a479-4ac8-984a-9baf4ff6ac2e tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:09.476298 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-885a4289-a479-4ac8-984a-9baf4ff6ac2e tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:09.482189 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-885a4289-a479-4ac8-984a-9baf4ff6ac2e tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:09.482637 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-885a4289-a479-4ac8-984a-9baf4ff6ac2e tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:09.483399 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-885a4289-a479-4ac8-984a-9baf4ff6ac2e tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:09.483860 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-885a4289-a479-4ac8-984a-9baf4ff6ac2e tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:09.510462 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e5740e07-1178-4ff3-8344-1048bb31d909 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:09.511189 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e5740e07-1178-4ff3-8344-1048bb31d909 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:09.516991 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e5740e07-1178-4ff3-8344-1048bb31d909 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:09.517453 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e5740e07-1178-4ff3-8344-1048bb31d909 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:09.518222 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e5740e07-1178-4ff3-8344-1048bb31d909 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:09.518664 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e5740e07-1178-4ff3-8344-1048bb31d909 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:09.607757 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-885a4289-a479-4ac8-984a-9baf4ff6ac2e tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:09.615596 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-885a4289-a479-4ac8-984a-9baf4ff6ac2e tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1315 microversion: 2.1 time: 0.143997 Apr 11 13:56:09.616199 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 48/90] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:09 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:09.646082 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e5740e07-1178-4ff3-8344-1048bb31d909 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:09.653218 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e5740e07-1178-4ff3-8344-1048bb31d909 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1321 microversion: 2.1 time: 0.146556 Apr 11 13:56:09.653790 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 43/91] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:09 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:56:09.759201 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cecc7407-59b1-4788-a173-a2da7105df31 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:09.761140 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cecc7407-59b1-4788-a173-a2da7105df31 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:09.771979 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cecc7407-59b1-4788-a173-a2da7105df31 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:09.771979 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cecc7407-59b1-4788-a173-a2da7105df31 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:09.771979 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cecc7407-59b1-4788-a173-a2da7105df31 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:09.771979 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cecc7407-59b1-4788-a173-a2da7105df31 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:09.901057 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cecc7407-59b1-4788-a173-a2da7105df31 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:09.908832 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cecc7407-59b1-4788-a173-a2da7105df31 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:09.910862 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cecc7407-59b1-4788-a173-a2da7105df31 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:09.911993 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cecc7407-59b1-4788-a173-a2da7105df31 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 0.156837 Apr 11 13:56:09.912558 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 49/92] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:56:09 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:56:10.596213 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-a6b804af-aed8-4edd-852c-cea776419f15 req-9138b7c1-d19d-496b-8708-ce0e125a18a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea0ff31-35c2-4763-bf7a-6d0aada0558c", "name": "network-vif-plugged", "status": "completed", "tag": "b53ccbb2-cadf-467b-980a-34cb619111ad"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:56:10.606199 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-a6b804af-aed8-4edd-852c-cea776419f15 req-9138b7c1-d19d-496b-8708-ce0e125a18a1 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:10.606849 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-a6b804af-aed8-4edd-852c-cea776419f15 req-9138b7c1-d19d-496b-8708-ce0e125a18a1 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:10.622155 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-a6b804af-aed8-4edd-852c-cea776419f15 req-9138b7c1-d19d-496b-8708-ce0e125a18a1 service nova] Creating event network-vif-plugged:b53ccbb2-cadf-467b-980a-34cb619111ad for instance eea0ff31-35c2-4763-bf7a-6d0aada0558c on hv-cinder-83078 Apr 11 13:56:10.629554 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-a6b804af-aed8-4edd-852c-cea776419f15 req-9138b7c1-d19d-496b-8708-ce0e125a18a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038391 Apr 11 13:56:10.630811 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 44/93] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:56:10.633014 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5361a05f-7439-4961-88f5-3d39cf81af6a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:10.634165 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5361a05f-7439-4961-88f5-3d39cf81af6a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:10.640085 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5361a05f-7439-4961-88f5-3d39cf81af6a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:10.640530 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5361a05f-7439-4961-88f5-3d39cf81af6a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:10.641501 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5361a05f-7439-4961-88f5-3d39cf81af6a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:10.641926 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5361a05f-7439-4961-88f5-3d39cf81af6a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:10.673903 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-00f542c6-f8df-4050-a1c2-65402e97a396 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:10.675097 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-00f542c6-f8df-4050-a1c2-65402e97a396 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:10.682416 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-00f542c6-f8df-4050-a1c2-65402e97a396 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:10.683098 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-00f542c6-f8df-4050-a1c2-65402e97a396 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:10.684220 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-00f542c6-f8df-4050-a1c2-65402e97a396 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:10.684740 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-00f542c6-f8df-4050-a1c2-65402e97a396 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:10.774833 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5361a05f-7439-4961-88f5-3d39cf81af6a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:10.782661 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5361a05f-7439-4961-88f5-3d39cf81af6a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1501 microversion: 2.1 time: 0.154039 Apr 11 13:56:10.783248 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 50/94] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:10 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:10.845802 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-00f542c6-f8df-4050-a1c2-65402e97a396 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:10.866754 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-00f542c6-f8df-4050-a1c2-65402e97a396 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1321 microversion: 2.1 time: 0.200023 Apr 11 13:56:10.876353 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 45/95] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:10 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:56:10.931077 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-be183e9b-2901-428c-b856-9d2b72601161 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:10.931998 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-be183e9b-2901-428c-b856-9d2b72601161 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:10.937825 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be183e9b-2901-428c-b856-9d2b72601161 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:10.938449 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be183e9b-2901-428c-b856-9d2b72601161 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:10.939224 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be183e9b-2901-428c-b856-9d2b72601161 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:10.939688 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be183e9b-2901-428c-b856-9d2b72601161 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:11.119499 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-be183e9b-2901-428c-b856-9d2b72601161 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:11.129854 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-be183e9b-2901-428c-b856-9d2b72601161 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:11.134472 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-be183e9b-2901-428c-b856-9d2b72601161 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:11.138008 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-be183e9b-2901-428c-b856-9d2b72601161 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 0.210885 Apr 11 13:56:11.140590 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 51/96] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:56:10 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:56:11.884693 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d3f34ab2-031a-4069-bea6-5fc566b5e76e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:11.885210 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d3f34ab2-031a-4069-bea6-5fc566b5e76e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:11.896582 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d3f34ab2-031a-4069-bea6-5fc566b5e76e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:11.897047 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d3f34ab2-031a-4069-bea6-5fc566b5e76e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:11.897852 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d3f34ab2-031a-4069-bea6-5fc566b5e76e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:11.898295 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d3f34ab2-031a-4069-bea6-5fc566b5e76e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:12.109204 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d3f34ab2-031a-4069-bea6-5fc566b5e76e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:12.117272 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d3f34ab2-031a-4069-bea6-5fc566b5e76e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1515 microversion: 2.1 time: 0.236603 Apr 11 13:56:12.118488 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 46/97] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:11 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:56:12.135206 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ade28545-e5f0-4372-84e9-181185a24aab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:56:12.136573 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ade28545-e5f0-4372-84e9-181185a24aab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:12.143816 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ade28545-e5f0-4372-84e9-181185a24aab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:12.144832 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ade28545-e5f0-4372-84e9-181185a24aab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:12.145694 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ade28545-e5f0-4372-84e9-181185a24aab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:12.146206 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ade28545-e5f0-4372-84e9-181185a24aab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:12.157606 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-636d2215-d74f-4309-8c89-052603a6bc94 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:12.158409 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-636d2215-d74f-4309-8c89-052603a6bc94 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:12.186434 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-636d2215-d74f-4309-8c89-052603a6bc94 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:12.187065 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-636d2215-d74f-4309-8c89-052603a6bc94 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:12.190168 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-636d2215-d74f-4309-8c89-052603a6bc94 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:12.190168 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-636d2215-d74f-4309-8c89-052603a6bc94 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:12.275414 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-ade28545-e5f0-4372-84e9-181185a24aab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lazy-loading 'flavor' on Instance uuid a6e921e1-7746-446b-bad6-d7188f8bdac2 {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 13:56:12.494255 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-636d2215-d74f-4309-8c89-052603a6bc94 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:12.497455 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ade28545-e5f0-4372-84e9-181185a24aab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "POST /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2/action" status: 200 len: 32 microversion: 2.1 time: 0.366311 Apr 11 13:56:12.499189 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 52/98] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 13:56:12 2022] POST /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2/action => generated 32 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 13:56:12.504173 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-636d2215-d74f-4309-8c89-052603a6bc94 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:12.509629 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-636d2215-d74f-4309-8c89-052603a6bc94 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:12.510217 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f6da325b-4dd9-4586-94e2-b779c132f6a4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2ee15aa-fbdd-47dd-bc05-9e66ed87e92f"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:56:12.511856 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f6da325b-4dd9-4586-94e2-b779c132f6a4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:12.514025 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-636d2215-d74f-4309-8c89-052603a6bc94 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1407 microversion: 2.20 time: 0.359340 Apr 11 13:56:12.519288 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6da325b-4dd9-4586-94e2-b779c132f6a4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:12.519939 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6da325b-4dd9-4586-94e2-b779c132f6a4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:12.520880 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6da325b-4dd9-4586-94e2-b779c132f6a4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:12.521529 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6da325b-4dd9-4586-94e2-b779c132f6a4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:12.523467 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 47/99] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:56:12 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1407 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:56:12.542897 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8ca4ad58-c903-4a0a-9d7a-2bf4575238ab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:12.543791 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8ca4ad58-c903-4a0a-9d7a-2bf4575238ab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:12.550964 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ca4ad58-c903-4a0a-9d7a-2bf4575238ab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:12.551690 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ca4ad58-c903-4a0a-9d7a-2bf4575238ab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:12.552691 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ca4ad58-c903-4a0a-9d7a-2bf4575238ab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:12.553282 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ca4ad58-c903-4a0a-9d7a-2bf4575238ab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:12.782104 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8ca4ad58-c903-4a0a-9d7a-2bf4575238ab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:12.793070 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8ca4ad58-c903-4a0a-9d7a-2bf4575238ab tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.268426 Apr 11 13:56:12.796991 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 48/100] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:12 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:13.133599 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f6da325b-4dd9-4586-94e2-b779c132f6a4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "POST /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.631690 Apr 11 13:56:13.135369 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 53/101] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 13:56:12 2022] POST /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a/os-volume_attachments => generated 194 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:56:13.538712 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6672d785-20c1-41f8-b510-7661c672b9c8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:13.539333 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6672d785-20c1-41f8-b510-7661c672b9c8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:13.548138 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6672d785-20c1-41f8-b510-7661c672b9c8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:13.549085 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6672d785-20c1-41f8-b510-7661c672b9c8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:13.549552 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6672d785-20c1-41f8-b510-7661c672b9c8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:13.550655 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6672d785-20c1-41f8-b510-7661c672b9c8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:13.765578 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6672d785-20c1-41f8-b510-7661c672b9c8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:13.779194 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6672d785-20c1-41f8-b510-7661c672b9c8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:13.782445 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6672d785-20c1-41f8-b510-7661c672b9c8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:13.784122 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6672d785-20c1-41f8-b510-7661c672b9c8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1599 microversion: 2.20 time: 0.251474 Apr 11 13:56:13.810062 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ae448bae-6d92-4d1b-9b89-0cdf20106ada tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:13.810960 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ae448bae-6d92-4d1b-9b89-0cdf20106ada tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:13.814224 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 49/102] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:56:13 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1599 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:56:13.830670 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-274a3898-f356-4e14-b978-0ae82709325b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:13.832126 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae448bae-6d92-4d1b-9b89-0cdf20106ada tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:13.832528 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-274a3898-f356-4e14-b978-0ae82709325b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:13.833415 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae448bae-6d92-4d1b-9b89-0cdf20106ada tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:13.835860 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae448bae-6d92-4d1b-9b89-0cdf20106ada tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:13.836302 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae448bae-6d92-4d1b-9b89-0cdf20106ada tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:13.860193 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-274a3898-f356-4e14-b978-0ae82709325b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:13.860990 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-274a3898-f356-4e14-b978-0ae82709325b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:13.864445 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-274a3898-f356-4e14-b978-0ae82709325b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:13.866020 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-274a3898-f356-4e14-b978-0ae82709325b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:14.003833 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ae448bae-6d92-4d1b-9b89-0cdf20106ada tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.200227 Apr 11 13:56:14.005734 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 54/103] 10.222.0.67 () {60 vars in 1315 bytes} [Mon Apr 11 13:56:13 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-interface => generated 285 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:56:14.056221 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-274a3898-f356-4e14-b978-0ae82709325b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:14.071176 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-274a3898-f356-4e14-b978-0ae82709325b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.252932 Apr 11 13:56:14.080590 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 50/104] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:13 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:15.088371 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-95fbf957-aca1-433d-a838-61edfc5aff96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:15.089065 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-95fbf957-aca1-433d-a838-61edfc5aff96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:15.095603 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-95fbf957-aca1-433d-a838-61edfc5aff96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:15.096205 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-95fbf957-aca1-433d-a838-61edfc5aff96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:15.097010 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-95fbf957-aca1-433d-a838-61edfc5aff96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:15.097481 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-95fbf957-aca1-433d-a838-61edfc5aff96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:15.476036 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-95fbf957-aca1-433d-a838-61edfc5aff96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:15.487197 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-95fbf957-aca1-433d-a838-61edfc5aff96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.402639 Apr 11 13:56:15.491962 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 55/105] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:15 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:16.061714 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-113da136-f636-4f3e-a158-269fc1f0410b req-e99460d3-c46e-4d4e-997d-0f6b8a6f29fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5f3b7d-8b92-4264-b41a-1d1ade879f2f", "tag": "cda04f4a-80ef-4c18-b575-cb87293272ce"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:56:16.076062 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-113da136-f636-4f3e-a158-269fc1f0410b req-e99460d3-c46e-4d4e-997d-0f6b8a6f29fc service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:16.077023 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-113da136-f636-4f3e-a158-269fc1f0410b req-e99460d3-c46e-4d4e-997d-0f6b8a6f29fc service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:16.105654 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-113da136-f636-4f3e-a158-269fc1f0410b req-e99460d3-c46e-4d4e-997d-0f6b8a6f29fc service nova] Creating event network-changed:cda04f4a-80ef-4c18-b575-cb87293272ce for instance 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f on hv-cinder-83078 Apr 11 13:56:16.127660 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-113da136-f636-4f3e-a158-269fc1f0410b req-e99460d3-c46e-4d4e-997d-0f6b8a6f29fc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064276 Apr 11 13:56:16.129311 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 51/106] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:56:16.509851 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5f39809c-2dd4-471d-95dd-6453f62adc4c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:16.511224 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5f39809c-2dd4-471d-95dd-6453f62adc4c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:16.518494 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f39809c-2dd4-471d-95dd-6453f62adc4c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:16.524656 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f39809c-2dd4-471d-95dd-6453f62adc4c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:16.529799 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f39809c-2dd4-471d-95dd-6453f62adc4c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:16.530509 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f39809c-2dd4-471d-95dd-6453f62adc4c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:16.897365 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5f39809c-2dd4-471d-95dd-6453f62adc4c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:16.912658 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5f39809c-2dd4-471d-95dd-6453f62adc4c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.405501 Apr 11 13:56:16.914756 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 56/107] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:16 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:17.932503 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cf47ab53-0c09-4c1d-8fee-226ffe077daf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:17.933192 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cf47ab53-0c09-4c1d-8fee-226ffe077daf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:17.951463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf47ab53-0c09-4c1d-8fee-226ffe077daf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:17.952046 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf47ab53-0c09-4c1d-8fee-226ffe077daf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:17.952921 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf47ab53-0c09-4c1d-8fee-226ffe077daf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:17.953458 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf47ab53-0c09-4c1d-8fee-226ffe077daf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:18.204012 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cf47ab53-0c09-4c1d-8fee-226ffe077daf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:18.218911 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cf47ab53-0c09-4c1d-8fee-226ffe077daf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.290637 Apr 11 13:56:18.221510 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 52/108] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:17 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:19.237632 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-88e7beb2-7588-4df5-8f63-a3cebc93ca8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:19.238293 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-88e7beb2-7588-4df5-8f63-a3cebc93ca8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:19.245514 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88e7beb2-7588-4df5-8f63-a3cebc93ca8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:19.245972 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88e7beb2-7588-4df5-8f63-a3cebc93ca8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:19.246754 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88e7beb2-7588-4df5-8f63-a3cebc93ca8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:19.247186 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88e7beb2-7588-4df5-8f63-a3cebc93ca8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:19.432734 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-88e7beb2-7588-4df5-8f63-a3cebc93ca8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:19.440570 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-88e7beb2-7588-4df5-8f63-a3cebc93ca8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.206757 Apr 11 13:56:19.441552 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 57/109] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:19 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:20.458436 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-759766fb-6078-42ed-8e99-ac293bdce145 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:20.459137 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-759766fb-6078-42ed-8e99-ac293bdce145 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:20.465089 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-759766fb-6078-42ed-8e99-ac293bdce145 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:20.465543 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-759766fb-6078-42ed-8e99-ac293bdce145 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:20.466328 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-759766fb-6078-42ed-8e99-ac293bdce145 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:20.466886 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-759766fb-6078-42ed-8e99-ac293bdce145 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:20.613219 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-759766fb-6078-42ed-8e99-ac293bdce145 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:20.620780 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-759766fb-6078-42ed-8e99-ac293bdce145 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.166832 Apr 11 13:56:20.621432 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 53/110] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:20 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:21.638465 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b965ca62-06b4-48be-9dc7-f1ab9f095642 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:21.639192 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b965ca62-06b4-48be-9dc7-f1ab9f095642 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:21.648606 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b965ca62-06b4-48be-9dc7-f1ab9f095642 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:21.649055 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b965ca62-06b4-48be-9dc7-f1ab9f095642 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:21.650132 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b965ca62-06b4-48be-9dc7-f1ab9f095642 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:21.650570 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b965ca62-06b4-48be-9dc7-f1ab9f095642 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:21.966821 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b965ca62-06b4-48be-9dc7-f1ab9f095642 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:21.975974 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b965ca62-06b4-48be-9dc7-f1ab9f095642 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.341391 Apr 11 13:56:21.976765 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 58/111] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:21 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:22.993443 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2b29f7de-7634-4fbe-b95b-5fdd26310243 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:22.994056 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2b29f7de-7634-4fbe-b95b-5fdd26310243 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:22.999904 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2b29f7de-7634-4fbe-b95b-5fdd26310243 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:23.000348 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2b29f7de-7634-4fbe-b95b-5fdd26310243 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:23.001101 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2b29f7de-7634-4fbe-b95b-5fdd26310243 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:23.001528 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2b29f7de-7634-4fbe-b95b-5fdd26310243 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:23.132765 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2b29f7de-7634-4fbe-b95b-5fdd26310243 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:23.141128 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2b29f7de-7634-4fbe-b95b-5fdd26310243 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.151353 Apr 11 13:56:23.141911 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 54/112] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:22 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:24.162863 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9514f58c-2d51-4ffc-a4a4-848870adb3c9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:24.164035 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9514f58c-2d51-4ffc-a4a4-848870adb3c9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:24.173479 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9514f58c-2d51-4ffc-a4a4-848870adb3c9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:24.176599 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9514f58c-2d51-4ffc-a4a4-848870adb3c9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:24.178304 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9514f58c-2d51-4ffc-a4a4-848870adb3c9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:24.178920 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9514f58c-2d51-4ffc-a4a4-848870adb3c9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:24.345294 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5753a58f-df2d-416e-a974-acaccb6a93ba tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:24.346611 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5753a58f-df2d-416e-a974-acaccb6a93ba tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:24.354652 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5753a58f-df2d-416e-a974-acaccb6a93ba tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:24.355276 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5753a58f-df2d-416e-a974-acaccb6a93ba tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:24.356235 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5753a58f-df2d-416e-a974-acaccb6a93ba tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:24.356817 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5753a58f-df2d-416e-a974-acaccb6a93ba tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:24.372492 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9514f58c-2d51-4ffc-a4a4-848870adb3c9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:24.385327 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9514f58c-2d51-4ffc-a4a4-848870adb3c9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.228905 Apr 11 13:56:24.385528 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5753a58f-df2d-416e-a974-acaccb6a93ba tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 13:56:24.386150 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 59/113] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:24 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:24.547026 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5753a58f-df2d-416e-a974-acaccb6a93ba tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 204 len: 0 microversion: 2.1 time: 0.205087 Apr 11 13:56:24.548119 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 55/114] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 13:56:24 2022] DELETE /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 13:56:24.556905 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ca34aa68-5a67-48dd-8dd8-0a74e39b90f1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:24.557532 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ca34aa68-5a67-48dd-8dd8-0a74e39b90f1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:24.566046 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca34aa68-5a67-48dd-8dd8-0a74e39b90f1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:24.566820 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca34aa68-5a67-48dd-8dd8-0a74e39b90f1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:24.567658 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca34aa68-5a67-48dd-8dd8-0a74e39b90f1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:24.568092 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca34aa68-5a67-48dd-8dd8-0a74e39b90f1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:24.725974 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ca34aa68-5a67-48dd-8dd8-0a74e39b90f1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:24.734984 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ca34aa68-5a67-48dd-8dd8-0a74e39b90f1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1553 microversion: 2.1 time: 0.181893 Apr 11 13:56:24.736288 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 60/115] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:24 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:56:25.404984 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0a0b36d6-f04b-49fe-b034-71fe3180934e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:25.405708 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0a0b36d6-f04b-49fe-b034-71fe3180934e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:25.414534 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0a0b36d6-f04b-49fe-b034-71fe3180934e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:25.415003 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0a0b36d6-f04b-49fe-b034-71fe3180934e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:25.416083 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0a0b36d6-f04b-49fe-b034-71fe3180934e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:25.416524 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0a0b36d6-f04b-49fe-b034-71fe3180934e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:25.644109 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0a0b36d6-f04b-49fe-b034-71fe3180934e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:25.653168 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0a0b36d6-f04b-49fe-b034-71fe3180934e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.253230 Apr 11 13:56:25.654108 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 56/116] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:25 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:56:25.753674 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-eaaafaea-8cb9-40cc-92d5-125e02abe202 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:25.755201 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-eaaafaea-8cb9-40cc-92d5-125e02abe202 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:25.762989 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eaaafaea-8cb9-40cc-92d5-125e02abe202 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:25.763784 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eaaafaea-8cb9-40cc-92d5-125e02abe202 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:25.764789 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eaaafaea-8cb9-40cc-92d5-125e02abe202 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:25.765489 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eaaafaea-8cb9-40cc-92d5-125e02abe202 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:25.976694 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-eaaafaea-8cb9-40cc-92d5-125e02abe202 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:25.987491 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-eaaafaea-8cb9-40cc-92d5-125e02abe202 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1553 microversion: 2.1 time: 0.238397 Apr 11 13:56:25.988136 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 61/117] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:25 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:26.670177 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-18ef5d8c-c1af-434e-a89c-07163bc5336b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:26.670804 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-18ef5d8c-c1af-434e-a89c-07163bc5336b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:26.678586 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-18ef5d8c-c1af-434e-a89c-07163bc5336b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:26.679278 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-18ef5d8c-c1af-434e-a89c-07163bc5336b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:26.680308 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-18ef5d8c-c1af-434e-a89c-07163bc5336b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:26.680976 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-18ef5d8c-c1af-434e-a89c-07163bc5336b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:26.863993 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-18ef5d8c-c1af-434e-a89c-07163bc5336b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:26.872086 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-18ef5d8c-c1af-434e-a89c-07163bc5336b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.205521 Apr 11 13:56:26.883019 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 57/118] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:26 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:27.011799 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ad68f84a-25b1-404e-895a-4d5aac169cbe tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:27.012418 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ad68f84a-25b1-404e-895a-4d5aac169cbe tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:27.019697 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad68f84a-25b1-404e-895a-4d5aac169cbe tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:27.020346 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad68f84a-25b1-404e-895a-4d5aac169cbe tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:27.021324 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad68f84a-25b1-404e-895a-4d5aac169cbe tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:27.021862 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad68f84a-25b1-404e-895a-4d5aac169cbe tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:27.335897 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ad68f84a-25b1-404e-895a-4d5aac169cbe tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:27.348560 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ad68f84a-25b1-404e-895a-4d5aac169cbe tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1553 microversion: 2.1 time: 0.347083 Apr 11 13:56:27.350880 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 62/119] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:27 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1553 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:27.674345 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-478dddd5-d589-4df0-bc5a-9d24e6d4c018 req-617caeac-6e43-4425-80c4-19ae0350fcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c0e150-9739-490b-84c2-340a7275b92a", "name": "network-vif-deleted", "tag": "9cd033d6-9a4d-4a1a-af53-9a6b9c9c2e71"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:56:27.682704 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-478dddd5-d589-4df0-bc5a-9d24e6d4c018 req-617caeac-6e43-4425-80c4-19ae0350fcc8 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:27.683260 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-478dddd5-d589-4df0-bc5a-9d24e6d4c018 req-617caeac-6e43-4425-80c4-19ae0350fcc8 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:27.694235 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-478dddd5-d589-4df0-bc5a-9d24e6d4c018 req-617caeac-6e43-4425-80c4-19ae0350fcc8 service nova] Creating event network-vif-deleted:9cd033d6-9a4d-4a1a-af53-9a6b9c9c2e71 for instance f2c0e150-9739-490b-84c2-340a7275b92a on hv-cinder-83078 Apr 11 13:56:27.699302 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-478dddd5-d589-4df0-bc5a-9d24e6d4c018 req-617caeac-6e43-4425-80c4-19ae0350fcc8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029286 Apr 11 13:56:27.700004 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 58/120] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:56:27.889464 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-843241c2-7805-4d5c-a235-2fe7c2629951 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:27.890090 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-843241c2-7805-4d5c-a235-2fe7c2629951 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:27.898527 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-843241c2-7805-4d5c-a235-2fe7c2629951 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:27.898971 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-843241c2-7805-4d5c-a235-2fe7c2629951 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:27.903100 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-843241c2-7805-4d5c-a235-2fe7c2629951 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:27.912074 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-843241c2-7805-4d5c-a235-2fe7c2629951 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:28.061147 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-843241c2-7805-4d5c-a235-2fe7c2629951 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:28.069939 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-843241c2-7805-4d5c-a235-2fe7c2629951 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.184251 Apr 11 13:56:28.071045 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 63/121] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:27 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:28.370380 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7ca64a99-e15b-4982-94ad-5a8894ff7cd2 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:28.371515 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7ca64a99-e15b-4982-94ad-5a8894ff7cd2 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:28.390901 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ca64a99-e15b-4982-94ad-5a8894ff7cd2 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:28.391362 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ca64a99-e15b-4982-94ad-5a8894ff7cd2 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:28.399771 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ca64a99-e15b-4982-94ad-5a8894ff7cd2 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:28.399771 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ca64a99-e15b-4982-94ad-5a8894ff7cd2 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:28.448193 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ca64a99-e15b-4982-94ad-5a8894ff7cd2 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:28.448848 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ca64a99-e15b-4982-94ad-5a8894ff7cd2 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:28.449468 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-7ca64a99-e15b-4982-94ad-5a8894ff7cd2 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lazy-loading 'fault' on Instance uuid f2c0e150-9739-490b-84c2-340a7275b92a {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 13:56:28.498149 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7ca64a99-e15b-4982-94ad-5a8894ff7cd2 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b10dd2bce99432abf55a8d348cf1ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93aa1a74c2fc48ce81fde5490e3604bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:28.506608 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7ca64a99-e15b-4982-94ad-5a8894ff7cd2 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 200 len: 1351 microversion: 2.1 time: 0.141477 Apr 11 13:56:28.507194 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 59/122] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:28 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 1351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:29.087220 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-52f71724-e532-4a4d-a580-8148f29e4d53 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:29.087952 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-52f71724-e532-4a4d-a580-8148f29e4d53 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:29.094796 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-52f71724-e532-4a4d-a580-8148f29e4d53 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:29.095318 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-52f71724-e532-4a4d-a580-8148f29e4d53 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:29.096189 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-52f71724-e532-4a4d-a580-8148f29e4d53 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:29.096630 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-52f71724-e532-4a4d-a580-8148f29e4d53 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:29.265139 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-52f71724-e532-4a4d-a580-8148f29e4d53 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:29.272979 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-52f71724-e532-4a4d-a580-8148f29e4d53 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.189799 Apr 11 13:56:29.273570 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 64/123] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:29 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:29.524709 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1621b61a-af4c-47f2-97cb-f356eabc8dd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:29.525349 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1621b61a-af4c-47f2-97cb-f356eabc8dd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:29.532570 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1621b61a-af4c-47f2-97cb-f356eabc8dd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:29.534325 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1621b61a-af4c-47f2-97cb-f356eabc8dd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:29.535285 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1621b61a-af4c-47f2-97cb-f356eabc8dd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:29.536126 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1621b61a-af4c-47f2-97cb-f356eabc8dd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:29.581728 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-1621b61a-af4c-47f2-97cb-f356eabc8dd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] HTTP exception thrown: Instance f2c0e150-9739-490b-84c2-340a7275b92a could not be found. Apr 11 13:56:29.582360 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1621b61a-af4c-47f2-97cb-f356eabc8dd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Returning 404 to user: Instance f2c0e150-9739-490b-84c2-340a7275b92a could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:56:29.583217 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1621b61a-af4c-47f2-97cb-f356eabc8dd4 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 404 len: 111 microversion: 2.1 time: 0.062645 Apr 11 13:56:29.583815 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 60/124] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:29 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 13:56:29.727759 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b7347ec7-988d-46d5-95d9-4c103b83ab2a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:29.729165 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b7347ec7-988d-46d5-95d9-4c103b83ab2a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:29.737182 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b7347ec7-988d-46d5-95d9-4c103b83ab2a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:29.737987 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b7347ec7-988d-46d5-95d9-4c103b83ab2a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:29.738921 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b7347ec7-988d-46d5-95d9-4c103b83ab2a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:29.739431 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b7347ec7-988d-46d5-95d9-4c103b83ab2a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:29.757547 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-b7347ec7-988d-46d5-95d9-4c103b83ab2a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] HTTP exception thrown: Instance f2c0e150-9739-490b-84c2-340a7275b92a could not be found. Apr 11 13:56:29.758530 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b7347ec7-988d-46d5-95d9-4c103b83ab2a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Returning 404 to user: Instance f2c0e150-9739-490b-84c2-340a7275b92a could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:56:29.759550 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b7347ec7-988d-46d5-95d9-4c103b83ab2a tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041227 Apr 11 13:56:29.760257 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 65/125] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 13:56:29 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 13:56:30.290379 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-60b0c6c0-675a-4bc2-a2e5-34090e1e71da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:30.291017 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-60b0c6c0-675a-4bc2-a2e5-34090e1e71da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:30.297831 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60b0c6c0-675a-4bc2-a2e5-34090e1e71da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:30.300107 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60b0c6c0-675a-4bc2-a2e5-34090e1e71da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:30.302040 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60b0c6c0-675a-4bc2-a2e5-34090e1e71da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:30.302736 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60b0c6c0-675a-4bc2-a2e5-34090e1e71da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:30.517534 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-60b0c6c0-675a-4bc2-a2e5-34090e1e71da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:30.527703 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-60b0c6c0-675a-4bc2-a2e5-34090e1e71da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.241444 Apr 11 13:56:30.540228 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 61/126] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:30 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:31.061743 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4bb24b7c-4b33-46ec-8d1b-6a951d4202d1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:31.063323 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4bb24b7c-4b33-46ec-8d1b-6a951d4202d1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:31.072773 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4bb24b7c-4b33-46ec-8d1b-6a951d4202d1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:31.073423 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4bb24b7c-4b33-46ec-8d1b-6a951d4202d1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:31.074375 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4bb24b7c-4b33-46ec-8d1b-6a951d4202d1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:31.074967 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4bb24b7c-4b33-46ec-8d1b-6a951d4202d1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:31.091152 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-4bb24b7c-4b33-46ec-8d1b-6a951d4202d1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] HTTP exception thrown: Instance f2c0e150-9739-490b-84c2-340a7275b92a could not be found. Apr 11 13:56:31.092024 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4bb24b7c-4b33-46ec-8d1b-6a951d4202d1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Returning 404 to user: Instance f2c0e150-9739-490b-84c2-340a7275b92a could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:56:31.092844 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4bb24b7c-4b33-46ec-8d1b-6a951d4202d1 tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 404 len: 111 microversion: 2.1 time: 0.036832 Apr 11 13:56:31.093403 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 66/127] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 13:56:31 2022] DELETE /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 13:56:31.101290 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5d5e8243-388c-43ad-9304-cd499213e1af tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:31.101911 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5d5e8243-388c-43ad-9304-cd499213e1af tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] [instance: f2c0e150-9739-490b-84c2-340a7275b92a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:31.108068 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d5e8243-388c-43ad-9304-cd499213e1af tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:31.108531 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d5e8243-388c-43ad-9304-cd499213e1af tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:31.109359 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d5e8243-388c-43ad-9304-cd499213e1af tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:31.109768 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d5e8243-388c-43ad-9304-cd499213e1af tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:31.123427 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-5d5e8243-388c-43ad-9304-cd499213e1af tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] HTTP exception thrown: Instance f2c0e150-9739-490b-84c2-340a7275b92a could not be found. Apr 11 13:56:31.124055 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5d5e8243-388c-43ad-9304-cd499213e1af tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] Returning 404 to user: Instance f2c0e150-9739-490b-84c2-340a7275b92a could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:56:31.124890 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5d5e8243-388c-43ad-9304-cd499213e1af tempest-DeleteServersTestJSON-154822517 tempest-DeleteServersTestJSON-154822517-project] 10.222.0.67 "GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a" status: 404 len: 111 microversion: 2.1 time: 0.027398 Apr 11 13:56:31.125436 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 62/128] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:31 2022] GET /compute/v2.1/servers/f2c0e150-9739-490b-84c2-340a7275b92a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 13:56:31.546284 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-558b6ec6-7ab7-405c-a717-e003da4d3390 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:31.546892 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-558b6ec6-7ab7-405c-a717-e003da4d3390 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:31.556125 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-558b6ec6-7ab7-405c-a717-e003da4d3390 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:31.556615 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-558b6ec6-7ab7-405c-a717-e003da4d3390 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:31.557428 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-558b6ec6-7ab7-405c-a717-e003da4d3390 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:31.557873 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-558b6ec6-7ab7-405c-a717-e003da4d3390 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:31.737283 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-558b6ec6-7ab7-405c-a717-e003da4d3390 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:31.749701 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-558b6ec6-7ab7-405c-a717-e003da4d3390 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.207187 Apr 11 13:56:31.750728 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 67/129] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:31 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:32.767494 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ab600271-ee7c-4416-9748-eee8b58115ba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:32.768863 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ab600271-ee7c-4416-9748-eee8b58115ba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:32.777534 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ab600271-ee7c-4416-9748-eee8b58115ba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:32.779265 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ab600271-ee7c-4416-9748-eee8b58115ba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:32.781515 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ab600271-ee7c-4416-9748-eee8b58115ba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:32.782126 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ab600271-ee7c-4416-9748-eee8b58115ba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:32.951489 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ab600271-ee7c-4416-9748-eee8b58115ba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:32.961595 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ab600271-ee7c-4416-9748-eee8b58115ba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.197888 Apr 11 13:56:32.972090 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 63/130] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:32 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:33.980431 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-af76394a-ca62-48e4-944a-6806b9fee7f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:33.981088 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-af76394a-ca62-48e4-944a-6806b9fee7f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:33.990497 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af76394a-ca62-48e4-944a-6806b9fee7f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:33.991827 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af76394a-ca62-48e4-944a-6806b9fee7f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:33.992771 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af76394a-ca62-48e4-944a-6806b9fee7f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:33.993304 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af76394a-ca62-48e4-944a-6806b9fee7f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:34.228464 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-af76394a-ca62-48e4-944a-6806b9fee7f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:34.238637 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-af76394a-ca62-48e4-944a-6806b9fee7f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.262513 Apr 11 13:56:34.239225 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 68/131] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:33 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:35.256600 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1f6fd136-1745-43c9-9958-d21595523394 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:35.257237 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1f6fd136-1745-43c9-9958-d21595523394 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:35.268296 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f6fd136-1745-43c9-9958-d21595523394 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:35.268755 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f6fd136-1745-43c9-9958-d21595523394 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:35.269607 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f6fd136-1745-43c9-9958-d21595523394 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:35.270049 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f6fd136-1745-43c9-9958-d21595523394 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:35.627604 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1f6fd136-1745-43c9-9958-d21595523394 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:35.638358 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1f6fd136-1745-43c9-9958-d21595523394 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.386916 Apr 11 13:56:35.649640 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 64/132] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:35 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:36.656970 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-612781e0-a6c3-4977-874f-20364a4826a5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:36.657888 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-612781e0-a6c3-4977-874f-20364a4826a5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:36.665430 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-612781e0-a6c3-4977-874f-20364a4826a5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:36.666804 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-612781e0-a6c3-4977-874f-20364a4826a5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:36.667756 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-612781e0-a6c3-4977-874f-20364a4826a5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:36.668559 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-612781e0-a6c3-4977-874f-20364a4826a5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:36.877745 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-612781e0-a6c3-4977-874f-20364a4826a5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:36.894994 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-612781e0-a6c3-4977-874f-20364a4826a5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.238770 Apr 11 13:56:36.895824 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 69/133] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:36 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:37.912331 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d418b340-a4ee-48b0-8bfd-6faedf191a6a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:37.913744 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d418b340-a4ee-48b0-8bfd-6faedf191a6a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:37.926398 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d418b340-a4ee-48b0-8bfd-6faedf191a6a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:37.929023 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d418b340-a4ee-48b0-8bfd-6faedf191a6a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:37.929818 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d418b340-a4ee-48b0-8bfd-6faedf191a6a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:37.930264 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d418b340-a4ee-48b0-8bfd-6faedf191a6a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:38.199354 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d418b340-a4ee-48b0-8bfd-6faedf191a6a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:38.212267 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d418b340-a4ee-48b0-8bfd-6faedf191a6a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.302670 Apr 11 13:56:38.212820 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 65/134] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:37 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:39.230903 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-72f715af-0bcc-4005-856f-e939bd153a9e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:39.233772 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-72f715af-0bcc-4005-856f-e939bd153a9e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:39.252272 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-72f715af-0bcc-4005-856f-e939bd153a9e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:39.252730 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-72f715af-0bcc-4005-856f-e939bd153a9e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:39.253523 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-72f715af-0bcc-4005-856f-e939bd153a9e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:39.253955 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-72f715af-0bcc-4005-856f-e939bd153a9e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:39.549125 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-72f715af-0bcc-4005-856f-e939bd153a9e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:39.560794 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-72f715af-0bcc-4005-856f-e939bd153a9e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.334542 Apr 11 13:56:39.565269 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 70/135] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:39 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:40.358084 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3426698b-2cc5-4531-be09-05d54c3c18f7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Action: 'create', calling method: .version_select at 0x7f7307566d30>, body: {"keypair": {"name": "tempest-keypair-233368395"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:56:40.382267 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-3426698b-2cc5-4531-be09-05d54c3c18f7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Getting quotas for project f8720d1d0e26443d96a5f29175402af6. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:56:40.386906 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-3426698b-2cc5-4531-be09-05d54c3c18f7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Getting quotas for user 1bcde529b708471eb9c1b74e15b588b7 and project f8720d1d0e26443d96a5f29175402af6. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:56:40.519711 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-3426698b-2cc5-4531-be09-05d54c3c18f7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Getting quotas for project f8720d1d0e26443d96a5f29175402af6. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:56:40.523930 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-3426698b-2cc5-4531-be09-05d54c3c18f7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Getting quotas for user 1bcde529b708471eb9c1b74e15b588b7 and project f8720d1d0e26443d96a5f29175402af6. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:56:40.541813 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3426698b-2cc5-4531-be09-05d54c3c18f7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.550897 Apr 11 13:56:40.547689 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 66/136] 10.222.0.67 () {60 vars in 1157 bytes} [Mon Apr 11 13:56:39 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:40.580665 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ca8545ad-d246-420f-b378-a6b1b9cbdd96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:40.581286 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ca8545ad-d246-420f-b378-a6b1b9cbdd96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:40.592276 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca8545ad-d246-420f-b378-a6b1b9cbdd96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:40.593819 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca8545ad-d246-420f-b378-a6b1b9cbdd96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:40.594839 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca8545ad-d246-420f-b378-a6b1b9cbdd96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:40.596432 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca8545ad-d246-420f-b378-a6b1b9cbdd96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:40.946630 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ca8545ad-d246-420f-b378-a6b1b9cbdd96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:40.956595 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ca8545ad-d246-420f-b378-a6b1b9cbdd96 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.381874 Apr 11 13:56:40.957738 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 71/137] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:40 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:41.975159 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-379524ef-bb09-4150-9d9f-bb232614f920 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:41.975949 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-379524ef-bb09-4150-9d9f-bb232614f920 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:41.987521 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-379524ef-bb09-4150-9d9f-bb232614f920 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:41.989106 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-379524ef-bb09-4150-9d9f-bb232614f920 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:41.993415 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-379524ef-bb09-4150-9d9f-bb232614f920 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:41.995048 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-379524ef-bb09-4150-9d9f-bb232614f920 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:42.226711 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-379524ef-bb09-4150-9d9f-bb232614f920 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:42.234994 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-379524ef-bb09-4150-9d9f-bb232614f920 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.264657 Apr 11 13:56:42.236318 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 67/138] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:41 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:42.758236 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2129835404", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "257d7092-c4df-47e4-abc9-31af4018d257"}], "security_groups": [{"name": "tempest-securitygroup--723908712"}], "key_name": "tempest-keypair-233368395", "user_data": "}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:56:42.924332 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] validate_networks() for [('257d7092-c4df-47e4-abc9-31af4018d257', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 13:56:43.253027 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-89a73fbd-067b-460b-814f-c158d3181fdc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:43.253664 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-89a73fbd-067b-460b-814f-c158d3181fdc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:43.260785 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89a73fbd-067b-460b-814f-c158d3181fdc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:43.272354 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89a73fbd-067b-460b-814f-c158d3181fdc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:43.273467 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89a73fbd-067b-460b-814f-c158d3181fdc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:43.273915 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89a73fbd-067b-460b-814f-c158d3181fdc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:43.462524 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 13:56:43.462954 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 13:56:43.464207 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 13:56:43.464809 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 13:56:43.465414 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 13:56:43.477553 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:43.478209 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:43.479172 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:43.479815 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:43.487188 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-89a73fbd-067b-460b-814f-c158d3181fdc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:43.507187 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Getting quotas for project f8720d1d0e26443d96a5f29175402af6. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:56:43.508659 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-89a73fbd-067b-460b-814f-c158d3181fdc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.259839 Apr 11 13:56:43.509770 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 68/139] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:43 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:43.522547 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Getting quotas for user 1bcde529b708471eb9c1b74e15b588b7 and project f8720d1d0e26443d96a5f29175402af6. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:56:43.535693 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 13:56:43.538976 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 13:56:43.740223 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2b9ba5bd-373e-46f3-8ae1-c3d099549537 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.980423 Apr 11 13:56:43.742601 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 72/140] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 13:56:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 13:56:43.754539 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-932edf0e-2805-4686-a03b-ce2185eebee7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:43.755303 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-932edf0e-2805-4686-a03b-ce2185eebee7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:43.842524 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-932edf0e-2805-4686-a03b-ce2185eebee7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:43.864795 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-932edf0e-2805-4686-a03b-ce2185eebee7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1237 microversion: 2.1 time: 0.113949 Apr 11 13:56:43.865533 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 69/141] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:43 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1237 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:44.527698 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1d2d2f97-63a5-4def-a352-1daff3517506 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:44.529097 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1d2d2f97-63a5-4def-a352-1daff3517506 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:44.537657 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1d2d2f97-63a5-4def-a352-1daff3517506 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:44.538121 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1d2d2f97-63a5-4def-a352-1daff3517506 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:44.542735 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1d2d2f97-63a5-4def-a352-1daff3517506 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:44.543378 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1d2d2f97-63a5-4def-a352-1daff3517506 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:44.693654 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1d2d2f97-63a5-4def-a352-1daff3517506 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:44.701035 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1d2d2f97-63a5-4def-a352-1daff3517506 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.178471 Apr 11 13:56:44.701705 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 73/142] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:44 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:56:44.884709 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f33443dc-2db4-472f-818b-a26c320d62ac tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:44.885402 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f33443dc-2db4-472f-818b-a26c320d62ac tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:44.895768 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f33443dc-2db4-472f-818b-a26c320d62ac tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:44.896388 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f33443dc-2db4-472f-818b-a26c320d62ac tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:44.897378 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f33443dc-2db4-472f-818b-a26c320d62ac tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:44.898214 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f33443dc-2db4-472f-818b-a26c320d62ac tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:45.005652 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f33443dc-2db4-472f-818b-a26c320d62ac tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:45.017965 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f33443dc-2db4-472f-818b-a26c320d62ac tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1289 microversion: 2.1 time: 0.138507 Apr 11 13:56:45.018662 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 70/143] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:44 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1289 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:45.718220 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-398b33c2-5a6b-492f-b86a-c4f7b2762b7f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:45.718965 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-398b33c2-5a6b-492f-b86a-c4f7b2762b7f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:45.726394 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-398b33c2-5a6b-492f-b86a-c4f7b2762b7f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:45.726954 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-398b33c2-5a6b-492f-b86a-c4f7b2762b7f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:45.727840 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-398b33c2-5a6b-492f-b86a-c4f7b2762b7f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:45.728343 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-398b33c2-5a6b-492f-b86a-c4f7b2762b7f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:45.960812 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-398b33c2-5a6b-492f-b86a-c4f7b2762b7f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:45.968720 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-398b33c2-5a6b-492f-b86a-c4f7b2762b7f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.254405 Apr 11 13:56:45.969790 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 74/144] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:45 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:46.035365 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a3972354-4990-4fbe-b1ba-cf85c0e4b121 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:46.036158 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a3972354-4990-4fbe-b1ba-cf85c0e4b121 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:46.042473 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a3972354-4990-4fbe-b1ba-cf85c0e4b121 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:46.043230 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a3972354-4990-4fbe-b1ba-cf85c0e4b121 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:46.043786 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a3972354-4990-4fbe-b1ba-cf85c0e4b121 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:46.044159 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a3972354-4990-4fbe-b1ba-cf85c0e4b121 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:46.221979 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a3972354-4990-4fbe-b1ba-cf85c0e4b121 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:46.233207 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a3972354-4990-4fbe-b1ba-cf85c0e4b121 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.202792 Apr 11 13:56:46.244397 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 71/145] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:46 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:46.987251 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e7b1ba8e-7002-4a88-a19f-bcf6c54e578f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:46.987967 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e7b1ba8e-7002-4a88-a19f-bcf6c54e578f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:46.994347 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e7b1ba8e-7002-4a88-a19f-bcf6c54e578f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:46.994859 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e7b1ba8e-7002-4a88-a19f-bcf6c54e578f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:46.995776 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e7b1ba8e-7002-4a88-a19f-bcf6c54e578f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:46.996271 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e7b1ba8e-7002-4a88-a19f-bcf6c54e578f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:47.168088 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e7b1ba8e-7002-4a88-a19f-bcf6c54e578f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:47.176310 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e7b1ba8e-7002-4a88-a19f-bcf6c54e578f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.193777 Apr 11 13:56:47.176885 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 75/146] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:46 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:47.250643 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0c08a6d5-6ade-4cbf-9d7e-3f717b35036b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:47.251461 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0c08a6d5-6ade-4cbf-9d7e-3f717b35036b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:47.258212 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c08a6d5-6ade-4cbf-9d7e-3f717b35036b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:47.258822 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c08a6d5-6ade-4cbf-9d7e-3f717b35036b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:47.259731 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c08a6d5-6ade-4cbf-9d7e-3f717b35036b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:47.260246 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c08a6d5-6ade-4cbf-9d7e-3f717b35036b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:47.425913 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0c08a6d5-6ade-4cbf-9d7e-3f717b35036b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:47.433592 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0c08a6d5-6ade-4cbf-9d7e-3f717b35036b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.187173 Apr 11 13:56:47.434237 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 72/147] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:47 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:48.193311 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4248fbad-b24c-4021-a04f-fbc9f75081db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:48.193929 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4248fbad-b24c-4021-a04f-fbc9f75081db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:48.200179 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4248fbad-b24c-4021-a04f-fbc9f75081db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:48.200634 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4248fbad-b24c-4021-a04f-fbc9f75081db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:48.201400 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4248fbad-b24c-4021-a04f-fbc9f75081db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:48.201833 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4248fbad-b24c-4021-a04f-fbc9f75081db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:48.333639 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4248fbad-b24c-4021-a04f-fbc9f75081db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:48.341355 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4248fbad-b24c-4021-a04f-fbc9f75081db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.152068 Apr 11 13:56:48.341927 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 76/148] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:48 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:48.458841 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d6697683-1887-4221-826a-30cd20ab302c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:48.460937 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d6697683-1887-4221-826a-30cd20ab302c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:48.470679 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d6697683-1887-4221-826a-30cd20ab302c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:48.471059 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d6697683-1887-4221-826a-30cd20ab302c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:48.471874 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d6697683-1887-4221-826a-30cd20ab302c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:48.472306 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d6697683-1887-4221-826a-30cd20ab302c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:48.629544 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d6697683-1887-4221-826a-30cd20ab302c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:48.637634 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d6697683-1887-4221-826a-30cd20ab302c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.191137 Apr 11 13:56:48.647942 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 73/149] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:48 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:49.089473 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-61b85fbc-4c12-4f85-ab9f-c0575a81512d req-3d2ab8e1-a7fb-45f7-8f1e-8b8d46ea764f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54dcdce4-931a-42d3-b36a-321afffabdc0", "tag": "73309a92-0432-4081-a050-fdeb449dfc6d"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:56:49.097621 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-61b85fbc-4c12-4f85-ab9f-c0575a81512d req-3d2ab8e1-a7fb-45f7-8f1e-8b8d46ea764f service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:49.098263 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-61b85fbc-4c12-4f85-ab9f-c0575a81512d req-3d2ab8e1-a7fb-45f7-8f1e-8b8d46ea764f service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:49.109173 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-61b85fbc-4c12-4f85-ab9f-c0575a81512d req-3d2ab8e1-a7fb-45f7-8f1e-8b8d46ea764f service nova] Creating event network-changed:73309a92-0432-4081-a050-fdeb449dfc6d for instance 54dcdce4-931a-42d3-b36a-321afffabdc0 on hv-cinder-83078 Apr 11 13:56:49.114647 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-61b85fbc-4c12-4f85-ab9f-c0575a81512d req-3d2ab8e1-a7fb-45f7-8f1e-8b8d46ea764f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028909 Apr 11 13:56:49.115255 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 77/150] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:56:49.358381 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6a08cce6-4a62-4ae6-a87f-9824f7f02f2f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:49.358994 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6a08cce6-4a62-4ae6-a87f-9824f7f02f2f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:49.365434 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6a08cce6-4a62-4ae6-a87f-9824f7f02f2f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:49.365882 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6a08cce6-4a62-4ae6-a87f-9824f7f02f2f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:49.366643 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6a08cce6-4a62-4ae6-a87f-9824f7f02f2f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:49.367065 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6a08cce6-4a62-4ae6-a87f-9824f7f02f2f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:49.535112 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6a08cce6-4a62-4ae6-a87f-9824f7f02f2f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:49.543053 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6a08cce6-4a62-4ae6-a87f-9824f7f02f2f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.188438 Apr 11 13:56:49.544469 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 74/151] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:49 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:49.655422 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-78b647d3-9035-4647-abfc-a58f71683c8b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:49.657060 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-78b647d3-9035-4647-abfc-a58f71683c8b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:49.669280 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78b647d3-9035-4647-abfc-a58f71683c8b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:49.669997 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78b647d3-9035-4647-abfc-a58f71683c8b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:49.670882 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78b647d3-9035-4647-abfc-a58f71683c8b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:49.675924 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78b647d3-9035-4647-abfc-a58f71683c8b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:49.877173 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-78b647d3-9035-4647-abfc-a58f71683c8b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:49.887098 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-78b647d3-9035-4647-abfc-a58f71683c8b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.236500 Apr 11 13:56:49.887801 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 78/152] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:49 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:50.561059 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9325999f-a6dd-45f0-bbd3-1c367dc0bd92 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:50.561707 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9325999f-a6dd-45f0-bbd3-1c367dc0bd92 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:50.569208 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9325999f-a6dd-45f0-bbd3-1c367dc0bd92 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:50.577462 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9325999f-a6dd-45f0-bbd3-1c367dc0bd92 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:50.577462 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9325999f-a6dd-45f0-bbd3-1c367dc0bd92 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:50.577462 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9325999f-a6dd-45f0-bbd3-1c367dc0bd92 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:50.697185 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9325999f-a6dd-45f0-bbd3-1c367dc0bd92 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:50.705019 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9325999f-a6dd-45f0-bbd3-1c367dc0bd92 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.147838 Apr 11 13:56:50.705588 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 75/153] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:50 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:50.904978 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-057a2ba0-2ed2-4cab-a767-45601291dfef tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:50.905623 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-057a2ba0-2ed2-4cab-a767-45601291dfef tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:50.912448 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-057a2ba0-2ed2-4cab-a767-45601291dfef tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:50.912894 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-057a2ba0-2ed2-4cab-a767-45601291dfef tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:50.913656 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-057a2ba0-2ed2-4cab-a767-45601291dfef tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:50.914088 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-057a2ba0-2ed2-4cab-a767-45601291dfef tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:51.045715 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-057a2ba0-2ed2-4cab-a767-45601291dfef tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:51.053233 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-057a2ba0-2ed2-4cab-a767-45601291dfef tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.152173 Apr 11 13:56:51.054014 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 79/154] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:50 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:51.721822 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-84f36a1b-a4c8-457a-8ca2-3ebf8bf6d6c3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:51.722358 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-84f36a1b-a4c8-457a-8ca2-3ebf8bf6d6c3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:51.728420 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-84f36a1b-a4c8-457a-8ca2-3ebf8bf6d6c3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:51.728876 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-84f36a1b-a4c8-457a-8ca2-3ebf8bf6d6c3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:51.729647 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-84f36a1b-a4c8-457a-8ca2-3ebf8bf6d6c3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:51.730088 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-84f36a1b-a4c8-457a-8ca2-3ebf8bf6d6c3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:51.854554 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-84f36a1b-a4c8-457a-8ca2-3ebf8bf6d6c3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:51.862752 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-84f36a1b-a4c8-457a-8ca2-3ebf8bf6d6c3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.144935 Apr 11 13:56:51.863335 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 76/155] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:51 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:52.070088 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b222ea37-aa18-4ce8-ae9e-eddab6499a6c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:52.070621 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b222ea37-aa18-4ce8-ae9e-eddab6499a6c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:52.076846 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b222ea37-aa18-4ce8-ae9e-eddab6499a6c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:52.077290 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b222ea37-aa18-4ce8-ae9e-eddab6499a6c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:52.078040 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b222ea37-aa18-4ce8-ae9e-eddab6499a6c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:52.078641 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b222ea37-aa18-4ce8-ae9e-eddab6499a6c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:52.206186 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b222ea37-aa18-4ce8-ae9e-eddab6499a6c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:52.213285 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b222ea37-aa18-4ce8-ae9e-eddab6499a6c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.147130 Apr 11 13:56:52.213868 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 80/156] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:52 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:52.881167 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c78dcd57-b49a-4dde-a1ae-1578eda759af tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:52.881779 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c78dcd57-b49a-4dde-a1ae-1578eda759af tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:52.887640 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c78dcd57-b49a-4dde-a1ae-1578eda759af tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:52.888097 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c78dcd57-b49a-4dde-a1ae-1578eda759af tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:52.888845 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c78dcd57-b49a-4dde-a1ae-1578eda759af tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:52.889297 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c78dcd57-b49a-4dde-a1ae-1578eda759af tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:53.018094 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c78dcd57-b49a-4dde-a1ae-1578eda759af tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:53.025229 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c78dcd57-b49a-4dde-a1ae-1578eda759af tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.147889 Apr 11 13:56:53.025793 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 77/157] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:52 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:53.230042 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-782aa9bf-9f50-4796-a3bf-2c701ea58ec3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:53.230661 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-782aa9bf-9f50-4796-a3bf-2c701ea58ec3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:53.238092 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-782aa9bf-9f50-4796-a3bf-2c701ea58ec3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:53.238699 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-782aa9bf-9f50-4796-a3bf-2c701ea58ec3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:53.239614 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-782aa9bf-9f50-4796-a3bf-2c701ea58ec3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:53.240078 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-782aa9bf-9f50-4796-a3bf-2c701ea58ec3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:53.367697 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-782aa9bf-9f50-4796-a3bf-2c701ea58ec3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:53.374778 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-782aa9bf-9f50-4796-a3bf-2c701ea58ec3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.148507 Apr 11 13:56:53.375335 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 81/158] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:53 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:54.041400 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6840ac35-ca5b-4394-a97e-e5b2e5a81a5d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:54.042042 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6840ac35-ca5b-4394-a97e-e5b2e5a81a5d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:54.048518 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6840ac35-ca5b-4394-a97e-e5b2e5a81a5d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:54.048972 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6840ac35-ca5b-4394-a97e-e5b2e5a81a5d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:54.049737 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6840ac35-ca5b-4394-a97e-e5b2e5a81a5d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:54.050174 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6840ac35-ca5b-4394-a97e-e5b2e5a81a5d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:54.177267 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6840ac35-ca5b-4394-a97e-e5b2e5a81a5d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:54.184894 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6840ac35-ca5b-4394-a97e-e5b2e5a81a5d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1521 microversion: 2.1 time: 0.147418 Apr 11 13:56:54.185461 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 78/159] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:54 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:56:54.397725 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a4298385-d3d3-4613-a0d1-b6cea497215c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:54.397725 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a4298385-d3d3-4613-a0d1-b6cea497215c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:54.402675 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4298385-d3d3-4613-a0d1-b6cea497215c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:54.402675 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4298385-d3d3-4613-a0d1-b6cea497215c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:54.403661 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4298385-d3d3-4613-a0d1-b6cea497215c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:54.404098 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4298385-d3d3-4613-a0d1-b6cea497215c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:54.535367 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a4298385-d3d3-4613-a0d1-b6cea497215c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:54.543010 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a4298385-d3d3-4613-a0d1-b6cea497215c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.155475 Apr 11 13:56:54.543588 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 82/160] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:54 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:55.202140 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-91a27bcd-4bf6-4d31-b96e-38354c1a5ce8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:55.202676 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-91a27bcd-4bf6-4d31-b96e-38354c1a5ce8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:55.209330 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-91a27bcd-4bf6-4d31-b96e-38354c1a5ce8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:55.209867 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-91a27bcd-4bf6-4d31-b96e-38354c1a5ce8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:55.210646 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-91a27bcd-4bf6-4d31-b96e-38354c1a5ce8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:55.211105 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-91a27bcd-4bf6-4d31-b96e-38354c1a5ce8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:55.529762 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-91a27bcd-4bf6-4d31-b96e-38354c1a5ce8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:55.539140 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-91a27bcd-4bf6-4d31-b96e-38354c1a5ce8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1501 microversion: 2.1 time: 0.340767 Apr 11 13:56:55.544045 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 79/161] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:55 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1501 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:55.556090 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a73876fa-f6a8-4128-a571-ed5a6383e4f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:55.557638 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a73876fa-f6a8-4128-a571-ed5a6383e4f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:55.563655 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-806ca5ac-6304-45fb-8d0d-d75fc0dcd0f5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:55.564173 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a73876fa-f6a8-4128-a571-ed5a6383e4f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:55.564482 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-806ca5ac-6304-45fb-8d0d-d75fc0dcd0f5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:55.564596 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a73876fa-f6a8-4128-a571-ed5a6383e4f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:55.565365 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a73876fa-f6a8-4128-a571-ed5a6383e4f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:55.565788 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a73876fa-f6a8-4128-a571-ed5a6383e4f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:55.571075 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-806ca5ac-6304-45fb-8d0d-d75fc0dcd0f5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:55.571528 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-806ca5ac-6304-45fb-8d0d-d75fc0dcd0f5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:55.572342 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-806ca5ac-6304-45fb-8d0d-d75fc0dcd0f5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:55.572794 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-806ca5ac-6304-45fb-8d0d-d75fc0dcd0f5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:55.713691 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-806ca5ac-6304-45fb-8d0d-d75fc0dcd0f5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:55.721842 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-806ca5ac-6304-45fb-8d0d-d75fc0dcd0f5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.163878 Apr 11 13:56:55.722650 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 80/162] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:55 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:56:55.722929 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a73876fa-f6a8-4128-a571-ed5a6383e4f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:55.730376 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a73876fa-f6a8-4128-a571-ed5a6383e4f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1515 microversion: 2.1 time: 0.178442 Apr 11 13:56:55.730944 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 83/163] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:55 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:56.738668 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2beb2f95-4481-44f7-bbab-b51faa00a7a0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:56.739311 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2beb2f95-4481-44f7-bbab-b51faa00a7a0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:56.745297 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2beb2f95-4481-44f7-bbab-b51faa00a7a0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:56.745748 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2beb2f95-4481-44f7-bbab-b51faa00a7a0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:56.746510 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2beb2f95-4481-44f7-bbab-b51faa00a7a0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:56.746945 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2beb2f95-4481-44f7-bbab-b51faa00a7a0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:56.877902 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2beb2f95-4481-44f7-bbab-b51faa00a7a0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:56.885011 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2beb2f95-4481-44f7-bbab-b51faa00a7a0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.150684 Apr 11 13:56:56.885582 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 81/164] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:56 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:57.902030 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-67b98f12-48b9-43d9-a6c6-f714f3d09763 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:57.902645 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-67b98f12-48b9-43d9-a6c6-f714f3d09763 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:57.909080 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67b98f12-48b9-43d9-a6c6-f714f3d09763 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:57.909532 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67b98f12-48b9-43d9-a6c6-f714f3d09763 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:57.910298 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67b98f12-48b9-43d9-a6c6-f714f3d09763 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:57.910735 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67b98f12-48b9-43d9-a6c6-f714f3d09763 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:58.039770 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-67b98f12-48b9-43d9-a6c6-f714f3d09763 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:58.047506 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-67b98f12-48b9-43d9-a6c6-f714f3d09763 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.149224 Apr 11 13:56:58.048197 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 84/165] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:57 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:56:59.064020 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7f774f2a-60ee-4abc-9283-c0f90563fc6f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:56:59.064698 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7f774f2a-60ee-4abc-9283-c0f90563fc6f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:56:59.070530 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7f774f2a-60ee-4abc-9283-c0f90563fc6f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:59.070992 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7f774f2a-60ee-4abc-9283-c0f90563fc6f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:59.071800 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7f774f2a-60ee-4abc-9283-c0f90563fc6f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:56:59.072253 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7f774f2a-60ee-4abc-9283-c0f90563fc6f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:56:59.204694 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7f774f2a-60ee-4abc-9283-c0f90563fc6f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:56:59.213677 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7f774f2a-60ee-4abc-9283-c0f90563fc6f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.153036 Apr 11 13:56:59.214453 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 82/166] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:56:59 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:00.230154 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c4cc1e27-87c4-4c84-8ab8-5bf8a2f590b8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:00.237692 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c4cc1e27-87c4-4c84-8ab8-5bf8a2f590b8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:00.244936 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c4cc1e27-87c4-4c84-8ab8-5bf8a2f590b8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:00.245635 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c4cc1e27-87c4-4c84-8ab8-5bf8a2f590b8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:00.246496 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c4cc1e27-87c4-4c84-8ab8-5bf8a2f590b8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:00.247015 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c4cc1e27-87c4-4c84-8ab8-5bf8a2f590b8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:00.377905 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c4cc1e27-87c4-4c84-8ab8-5bf8a2f590b8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:00.385179 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c4cc1e27-87c4-4c84-8ab8-5bf8a2f590b8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.158751 Apr 11 13:57:00.385751 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 85/167] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:00 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:01.402449 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ee02f3d8-5370-4430-aff2-3be04e65b182 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:01.403114 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ee02f3d8-5370-4430-aff2-3be04e65b182 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:01.408851 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ee02f3d8-5370-4430-aff2-3be04e65b182 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:01.410124 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ee02f3d8-5370-4430-aff2-3be04e65b182 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:01.410976 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ee02f3d8-5370-4430-aff2-3be04e65b182 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:01.411407 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ee02f3d8-5370-4430-aff2-3be04e65b182 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:01.534828 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ee02f3d8-5370-4430-aff2-3be04e65b182 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:01.541923 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ee02f3d8-5370-4430-aff2-3be04e65b182 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.143376 Apr 11 13:57:01.542488 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 83/168] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:01 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:02.185585 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-ce9f3d9c-995f-448d-99fd-76517ee1e015 req-9744c744-6e4e-4e0f-9f76-eb1733e27971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54dcdce4-931a-42d3-b36a-321afffabdc0", "name": "network-vif-plugged", "status": "completed", "tag": "73309a92-0432-4081-a050-fdeb449dfc6d"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:02.195013 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-ce9f3d9c-995f-448d-99fd-76517ee1e015 req-9744c744-6e4e-4e0f-9f76-eb1733e27971 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:02.195455 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-ce9f3d9c-995f-448d-99fd-76517ee1e015 req-9744c744-6e4e-4e0f-9f76-eb1733e27971 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:02.208935 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-ce9f3d9c-995f-448d-99fd-76517ee1e015 req-9744c744-6e4e-4e0f-9f76-eb1733e27971 service nova] Creating event network-vif-plugged:73309a92-0432-4081-a050-fdeb449dfc6d for instance 54dcdce4-931a-42d3-b36a-321afffabdc0 on hv-cinder-83078 Apr 11 13:57:02.213955 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-ce9f3d9c-995f-448d-99fd-76517ee1e015 req-9744c744-6e4e-4e0f-9f76-eb1733e27971 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033447 Apr 11 13:57:02.214553 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 86/169] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:57:02.360837 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-105181dc-7d08-4fff-8891-a2203f0922a9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:02.363219 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-105181dc-7d08-4fff-8891-a2203f0922a9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:02.397070 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-105181dc-7d08-4fff-8891-a2203f0922a9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:02.401892 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-105181dc-7d08-4fff-8891-a2203f0922a9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:02.403112 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-105181dc-7d08-4fff-8891-a2203f0922a9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:02.403944 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-105181dc-7d08-4fff-8891-a2203f0922a9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:02.440258 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-105181dc-7d08-4fff-8891-a2203f0922a9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lazy-loading 'flavor' on Instance uuid eea0ff31-35c2-4763-bf7a-6d0aada0558c {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 13:57:02.557411 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-105181dc-7d08-4fff-8891-a2203f0922a9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "POST /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c/action" status: 200 len: 32 microversion: 2.1 time: 0.204095 Apr 11 13:57:02.557976 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 84/170] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 13:57:02 2022] POST /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c/action => generated 32 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 13:57:02.560023 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d48ea979-2430-4789-a94a-e55b45701b14 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:02.560802 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d48ea979-2430-4789-a94a-e55b45701b14 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:02.567437 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2528c564-4e94-4963-8bfe-f9bb7cb6162a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:02.567761 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d48ea979-2430-4789-a94a-e55b45701b14 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:02.568168 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2528c564-4e94-4963-8bfe-f9bb7cb6162a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:02.568324 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d48ea979-2430-4789-a94a-e55b45701b14 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:02.569028 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d48ea979-2430-4789-a94a-e55b45701b14 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:02.569466 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d48ea979-2430-4789-a94a-e55b45701b14 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:02.574276 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2528c564-4e94-4963-8bfe-f9bb7cb6162a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:02.574728 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2528c564-4e94-4963-8bfe-f9bb7cb6162a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:02.575502 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2528c564-4e94-4963-8bfe-f9bb7cb6162a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:02.575962 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2528c564-4e94-4963-8bfe-f9bb7cb6162a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:02.717957 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d48ea979-2430-4789-a94a-e55b45701b14 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:02.718302 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2528c564-4e94-4963-8bfe-f9bb7cb6162a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:02.725637 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d48ea979-2430-4789-a94a-e55b45701b14 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.170468 Apr 11 13:57:02.725807 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2528c564-4e94-4963-8bfe-f9bb7cb6162a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.162653 Apr 11 13:57:02.726218 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 87/171] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:02 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:02.726361 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 85/172] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:02 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:03.742883 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e9531068-ed43-41c4-97e6-9a3d98dd9526 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:03.743698 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e9531068-ed43-41c4-97e6-9a3d98dd9526 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:03.748698 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b165cfbe-88e5-4054-859f-ab80d0e1c337 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:03.750379 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b165cfbe-88e5-4054-859f-ab80d0e1c337 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:03.750673 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e9531068-ed43-41c4-97e6-9a3d98dd9526 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:03.751351 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e9531068-ed43-41c4-97e6-9a3d98dd9526 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:03.752407 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e9531068-ed43-41c4-97e6-9a3d98dd9526 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:03.752906 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e9531068-ed43-41c4-97e6-9a3d98dd9526 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:03.761235 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b165cfbe-88e5-4054-859f-ab80d0e1c337 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:03.761870 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b165cfbe-88e5-4054-859f-ab80d0e1c337 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:03.762966 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b165cfbe-88e5-4054-859f-ab80d0e1c337 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:03.763596 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b165cfbe-88e5-4054-859f-ab80d0e1c337 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:03.934468 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e9531068-ed43-41c4-97e6-9a3d98dd9526 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:03.939213 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b165cfbe-88e5-4054-859f-ab80d0e1c337 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:03.942756 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e9531068-ed43-41c4-97e6-9a3d98dd9526 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.203731 Apr 11 13:57:03.948692 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b165cfbe-88e5-4054-859f-ab80d0e1c337 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1362 microversion: 2.1 time: 0.208160 Apr 11 13:57:03.949707 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 88/173] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:03 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:03.959834 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 86/174] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:03 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:04.969042 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ce36f721-4658-4324-bb19-042845d0385d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:04.970385 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ce36f721-4658-4324-bb19-042845d0385d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:04.975372 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-267e8917-35ef-480a-80bf-75a1477c612b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:04.976735 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-267e8917-35ef-480a-80bf-75a1477c612b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:04.984818 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-267e8917-35ef-480a-80bf-75a1477c612b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:04.985268 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-267e8917-35ef-480a-80bf-75a1477c612b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:04.986653 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ce36f721-4658-4324-bb19-042845d0385d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:04.986786 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-267e8917-35ef-480a-80bf-75a1477c612b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:04.987256 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-267e8917-35ef-480a-80bf-75a1477c612b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:04.988198 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ce36f721-4658-4324-bb19-042845d0385d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:04.989209 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ce36f721-4658-4324-bb19-042845d0385d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:04.990475 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ce36f721-4658-4324-bb19-042845d0385d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:05.142673 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ce36f721-4658-4324-bb19-042845d0385d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:05.146752 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-267e8917-35ef-480a-80bf-75a1477c612b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:05.155227 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-267e8917-35ef-480a-80bf-75a1477c612b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1549 microversion: 2.1 time: 0.193077 Apr 11 13:57:05.160112 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ce36f721-4658-4324-bb19-042845d0385d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.193022 Apr 11 13:57:05.160112 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 87/175] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:04 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:05.160543 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 89/176] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:04 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1549 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:05.173765 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e29643ae-5054-478f-bf52-358ed76a10e7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:05.174878 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e29643ae-5054-478f-bf52-358ed76a10e7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:05.181101 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e29643ae-5054-478f-bf52-358ed76a10e7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:05.181557 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e29643ae-5054-478f-bf52-358ed76a10e7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:05.182328 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e29643ae-5054-478f-bf52-358ed76a10e7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:05.182765 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e29643ae-5054-478f-bf52-358ed76a10e7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:05.263912 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e29643ae-5054-478f-bf52-358ed76a10e7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094583 Apr 11 13:57:05.264693 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 88/177] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Apr 11 13:57:05 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:57:06.177056 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a971c7e1-2b0e-4c63-8387-f188cece944e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:06.178712 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a971c7e1-2b0e-4c63-8387-f188cece944e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:06.192277 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a971c7e1-2b0e-4c63-8387-f188cece944e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:06.192737 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a971c7e1-2b0e-4c63-8387-f188cece944e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:06.193515 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a971c7e1-2b0e-4c63-8387-f188cece944e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:06.193984 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a971c7e1-2b0e-4c63-8387-f188cece944e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:06.413824 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a971c7e1-2b0e-4c63-8387-f188cece944e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:06.424317 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a971c7e1-2b0e-4c63-8387-f188cece944e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.251227 Apr 11 13:57:06.425573 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 90/178] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:06 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:06.846817 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-d597dec2-81ee-47b9-a45d-47b11234bc25 req-b1bd2844-f65b-4ecf-9b37-9b570f652a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54dcdce4-931a-42d3-b36a-321afffabdc0", "tag": "73309a92-0432-4081-a050-fdeb449dfc6d"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:06.859596 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-d597dec2-81ee-47b9-a45d-47b11234bc25 req-b1bd2844-f65b-4ecf-9b37-9b570f652a74 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:06.860308 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-d597dec2-81ee-47b9-a45d-47b11234bc25 req-b1bd2844-f65b-4ecf-9b37-9b570f652a74 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:06.873312 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-d597dec2-81ee-47b9-a45d-47b11234bc25 req-b1bd2844-f65b-4ecf-9b37-9b570f652a74 service nova] Creating event network-changed:73309a92-0432-4081-a050-fdeb449dfc6d for instance 54dcdce4-931a-42d3-b36a-321afffabdc0 on hv-cinder-83078 Apr 11 13:57:06.878562 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-d597dec2-81ee-47b9-a45d-47b11234bc25 req-b1bd2844-f65b-4ecf-9b37-9b570f652a74 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037006 Apr 11 13:57:06.879735 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 89/179] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:57:07.443225 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ff13b26d-3003-4c64-8bb0-958a7fcf02d5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:07.444133 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ff13b26d-3003-4c64-8bb0-958a7fcf02d5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:07.453116 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff13b26d-3003-4c64-8bb0-958a7fcf02d5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:07.453793 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff13b26d-3003-4c64-8bb0-958a7fcf02d5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:07.455195 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff13b26d-3003-4c64-8bb0-958a7fcf02d5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:07.457630 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff13b26d-3003-4c64-8bb0-958a7fcf02d5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:07.695476 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ff13b26d-3003-4c64-8bb0-958a7fcf02d5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:07.709475 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ff13b26d-3003-4c64-8bb0-958a7fcf02d5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.271741 Apr 11 13:57:07.710457 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 91/180] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:07 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:08.729439 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cfedade6-3a8d-444e-b826-5b6d5abf3d77 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:08.730142 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cfedade6-3a8d-444e-b826-5b6d5abf3d77 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:08.736130 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cfedade6-3a8d-444e-b826-5b6d5abf3d77 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:08.736586 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cfedade6-3a8d-444e-b826-5b6d5abf3d77 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:08.738743 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cfedade6-3a8d-444e-b826-5b6d5abf3d77 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:08.738743 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cfedade6-3a8d-444e-b826-5b6d5abf3d77 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:08.870374 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cfedade6-3a8d-444e-b826-5b6d5abf3d77 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:08.880973 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cfedade6-3a8d-444e-b826-5b6d5abf3d77 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.155560 Apr 11 13:57:08.881944 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 90/181] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:08 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:09.898805 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6173c558-9415-4ff9-bf17-17a77a2e3bf9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:09.899442 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6173c558-9415-4ff9-bf17-17a77a2e3bf9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:09.905404 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6173c558-9415-4ff9-bf17-17a77a2e3bf9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:09.905853 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6173c558-9415-4ff9-bf17-17a77a2e3bf9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:09.906621 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6173c558-9415-4ff9-bf17-17a77a2e3bf9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:09.907337 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6173c558-9415-4ff9-bf17-17a77a2e3bf9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:10.107440 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6173c558-9415-4ff9-bf17-17a77a2e3bf9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:10.117280 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6173c558-9415-4ff9-bf17-17a77a2e3bf9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.222210 Apr 11 13:57:10.117758 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 92/182] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:09 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:11.133113 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6d2a320d-4438-4faa-9fd1-b6da42cf3bc1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:11.133732 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6d2a320d-4438-4faa-9fd1-b6da42cf3bc1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:11.141036 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6d2a320d-4438-4faa-9fd1-b6da42cf3bc1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:11.141548 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6d2a320d-4438-4faa-9fd1-b6da42cf3bc1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:11.142477 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6d2a320d-4438-4faa-9fd1-b6da42cf3bc1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:11.143463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6d2a320d-4438-4faa-9fd1-b6da42cf3bc1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:11.281139 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6d2a320d-4438-4faa-9fd1-b6da42cf3bc1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:11.289087 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6d2a320d-4438-4faa-9fd1-b6da42cf3bc1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.159765 Apr 11 13:57:11.289668 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 91/183] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:11 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:12.306877 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-aefedf95-ada7-47c6-b53c-ff3a2da169c8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:12.307492 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-aefedf95-ada7-47c6-b53c-ff3a2da169c8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:12.314060 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aefedf95-ada7-47c6-b53c-ff3a2da169c8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:12.314552 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aefedf95-ada7-47c6-b53c-ff3a2da169c8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:12.315322 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aefedf95-ada7-47c6-b53c-ff3a2da169c8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:12.316366 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aefedf95-ada7-47c6-b53c-ff3a2da169c8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:12.453545 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-aefedf95-ada7-47c6-b53c-ff3a2da169c8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:12.459847 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-aefedf95-ada7-47c6-b53c-ff3a2da169c8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.156737 Apr 11 13:57:12.460443 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 93/184] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:12 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:13.476507 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0f65532f-a5f1-4082-b0cc-72584036808f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:13.477252 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0f65532f-a5f1-4082-b0cc-72584036808f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:13.488811 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f65532f-a5f1-4082-b0cc-72584036808f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:13.488811 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f65532f-a5f1-4082-b0cc-72584036808f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:13.488811 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f65532f-a5f1-4082-b0cc-72584036808f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:13.488811 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f65532f-a5f1-4082-b0cc-72584036808f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:13.616826 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0f65532f-a5f1-4082-b0cc-72584036808f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:13.624240 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0f65532f-a5f1-4082-b0cc-72584036808f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.151880 Apr 11 13:57:13.624918 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 92/185] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:13 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:14.642386 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f7f642b2-f81a-42d5-a763-dc49341f3904 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:14.642936 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f7f642b2-f81a-42d5-a763-dc49341f3904 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:14.649605 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f7f642b2-f81a-42d5-a763-dc49341f3904 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:14.650050 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f7f642b2-f81a-42d5-a763-dc49341f3904 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:14.650810 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f7f642b2-f81a-42d5-a763-dc49341f3904 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:14.651236 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f7f642b2-f81a-42d5-a763-dc49341f3904 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:14.788635 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f7f642b2-f81a-42d5-a763-dc49341f3904 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:14.796079 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f7f642b2-f81a-42d5-a763-dc49341f3904 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.157947 Apr 11 13:57:14.796644 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 94/186] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:14 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:15.812455 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-04ec2120-cfe1-4fde-b207-10e03e249d06 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:15.813246 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-04ec2120-cfe1-4fde-b207-10e03e249d06 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:15.820133 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-04ec2120-cfe1-4fde-b207-10e03e249d06 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:15.820582 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-04ec2120-cfe1-4fde-b207-10e03e249d06 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:15.821350 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-04ec2120-cfe1-4fde-b207-10e03e249d06 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:15.821863 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-04ec2120-cfe1-4fde-b207-10e03e249d06 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:15.951728 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-04ec2120-cfe1-4fde-b207-10e03e249d06 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:15.959414 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-04ec2120-cfe1-4fde-b207-10e03e249d06 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.150747 Apr 11 13:57:15.960091 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 93/187] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:15 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:16.975852 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7d430557-c76d-48f9-a85c-048992a8b269 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:16.976468 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7d430557-c76d-48f9-a85c-048992a8b269 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:16.982759 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7d430557-c76d-48f9-a85c-048992a8b269 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:16.983205 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7d430557-c76d-48f9-a85c-048992a8b269 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:16.983986 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7d430557-c76d-48f9-a85c-048992a8b269 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:16.984416 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7d430557-c76d-48f9-a85c-048992a8b269 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:17.132520 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7d430557-c76d-48f9-a85c-048992a8b269 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:17.140262 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7d430557-c76d-48f9-a85c-048992a8b269 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.168390 Apr 11 13:57:17.140923 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 95/188] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:16 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:18.156814 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e911c2af-ef0e-454f-ae2d-18dcd7890ac7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:18.157434 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e911c2af-ef0e-454f-ae2d-18dcd7890ac7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:18.164416 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e911c2af-ef0e-454f-ae2d-18dcd7890ac7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:18.164995 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e911c2af-ef0e-454f-ae2d-18dcd7890ac7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:18.165767 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e911c2af-ef0e-454f-ae2d-18dcd7890ac7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:18.166210 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e911c2af-ef0e-454f-ae2d-18dcd7890ac7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:18.306018 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e911c2af-ef0e-454f-ae2d-18dcd7890ac7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:18.313411 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e911c2af-ef0e-454f-ae2d-18dcd7890ac7 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.160390 Apr 11 13:57:18.313980 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 94/189] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:18 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:19.330536 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4191bc4f-99d1-48cc-96a5-9a10c04a9f40 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:19.331158 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4191bc4f-99d1-48cc-96a5-9a10c04a9f40 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:19.337526 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4191bc4f-99d1-48cc-96a5-9a10c04a9f40 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:19.337980 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4191bc4f-99d1-48cc-96a5-9a10c04a9f40 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:19.338749 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4191bc4f-99d1-48cc-96a5-9a10c04a9f40 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:19.339186 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4191bc4f-99d1-48cc-96a5-9a10c04a9f40 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:19.466646 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4191bc4f-99d1-48cc-96a5-9a10c04a9f40 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:19.475879 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4191bc4f-99d1-48cc-96a5-9a10c04a9f40 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.148971 Apr 11 13:57:19.476489 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 96/190] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:19 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:20.493631 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a21478a7-2ea2-42fc-a4c3-bf43e7befd65 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:20.494259 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a21478a7-2ea2-42fc-a4c3-bf43e7befd65 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:20.500146 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a21478a7-2ea2-42fc-a4c3-bf43e7befd65 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:20.500597 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a21478a7-2ea2-42fc-a4c3-bf43e7befd65 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:20.501356 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a21478a7-2ea2-42fc-a4c3-bf43e7befd65 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:20.501784 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a21478a7-2ea2-42fc-a4c3-bf43e7befd65 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:20.629453 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a21478a7-2ea2-42fc-a4c3-bf43e7befd65 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:20.637473 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a21478a7-2ea2-42fc-a4c3-bf43e7befd65 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.148200 Apr 11 13:57:20.638094 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 95/191] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:20 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:21.538666 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-644c1fc7-9d1c-4567-871a-1221654d8c8d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:21.539189 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-644c1fc7-9d1c-4567-871a-1221654d8c8d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:21.545589 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-644c1fc7-9d1c-4567-871a-1221654d8c8d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:21.546029 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-644c1fc7-9d1c-4567-871a-1221654d8c8d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:21.546783 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-644c1fc7-9d1c-4567-871a-1221654d8c8d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:21.547210 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-644c1fc7-9d1c-4567-871a-1221654d8c8d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:21.570779 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-644c1fc7-9d1c-4567-871a-1221654d8c8d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/ips" status: 200 len: 151 microversion: 2.20 time: 0.036512 Apr 11 13:57:21.571356 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 97/192] 10.222.0.67 () {60 vars in 1288 bytes} [Mon Apr 11 13:57:21 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:57:21.654420 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-057e3927-966e-4786-b39e-623162ee7482 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:21.655040 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-057e3927-966e-4786-b39e-623162ee7482 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:21.660767 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-057e3927-966e-4786-b39e-623162ee7482 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:21.661212 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-057e3927-966e-4786-b39e-623162ee7482 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:21.661968 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-057e3927-966e-4786-b39e-623162ee7482 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:21.662408 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-057e3927-966e-4786-b39e-623162ee7482 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:21.793717 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-057e3927-966e-4786-b39e-623162ee7482 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:21.801690 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-057e3927-966e-4786-b39e-623162ee7482 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.151084 Apr 11 13:57:21.802438 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 96/193] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:21 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:22.818622 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-38bd66a7-6e0b-4ffa-90c0-ee533dde67fa tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:22.819133 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-38bd66a7-6e0b-4ffa-90c0-ee533dde67fa tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:22.825414 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-38bd66a7-6e0b-4ffa-90c0-ee533dde67fa tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:22.825860 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-38bd66a7-6e0b-4ffa-90c0-ee533dde67fa tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:22.826611 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-38bd66a7-6e0b-4ffa-90c0-ee533dde67fa tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:22.827041 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-38bd66a7-6e0b-4ffa-90c0-ee533dde67fa tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:22.952340 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-38bd66a7-6e0b-4ffa-90c0-ee533dde67fa tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:22.960311 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-38bd66a7-6e0b-4ffa-90c0-ee533dde67fa tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.145530 Apr 11 13:57:22.960882 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 98/194] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:22 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:23.977353 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-14a92ac5-07df-4a2a-952d-b0c80028cfdd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:23.977959 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-14a92ac5-07df-4a2a-952d-b0c80028cfdd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:23.984424 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-14a92ac5-07df-4a2a-952d-b0c80028cfdd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:23.985161 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-14a92ac5-07df-4a2a-952d-b0c80028cfdd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:23.985948 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-14a92ac5-07df-4a2a-952d-b0c80028cfdd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:23.986389 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-14a92ac5-07df-4a2a-952d-b0c80028cfdd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:24.116061 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-14a92ac5-07df-4a2a-952d-b0c80028cfdd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:24.123439 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-14a92ac5-07df-4a2a-952d-b0c80028cfdd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.150159 Apr 11 13:57:24.124040 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 97/195] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:23 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:25.141007 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8ad00f89-8011-4cf6-b215-ec3633ba7479 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:25.141618 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8ad00f89-8011-4cf6-b215-ec3633ba7479 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:25.147914 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8ad00f89-8011-4cf6-b215-ec3633ba7479 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:25.148365 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8ad00f89-8011-4cf6-b215-ec3633ba7479 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:25.149124 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8ad00f89-8011-4cf6-b215-ec3633ba7479 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:25.149557 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8ad00f89-8011-4cf6-b215-ec3633ba7479 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:25.279306 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8ad00f89-8011-4cf6-b215-ec3633ba7479 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:25.288305 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8ad00f89-8011-4cf6-b215-ec3633ba7479 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.151033 Apr 11 13:57:25.288894 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 99/196] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:25 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:25.598762 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5cbfe657-35db-419c-819a-dbf3f4e8fbe5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:25.599324 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5cbfe657-35db-419c-819a-dbf3f4e8fbe5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:25.607504 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5cbfe657-35db-419c-819a-dbf3f4e8fbe5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:25.608202 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5cbfe657-35db-419c-819a-dbf3f4e8fbe5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:25.609058 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5cbfe657-35db-419c-819a-dbf3f4e8fbe5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:25.609569 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5cbfe657-35db-419c-819a-dbf3f4e8fbe5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:25.632860 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-5cbfe657-35db-419c-819a-dbf3f4e8fbe5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lazy-loading 'flavor' on Instance uuid 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 13:57:26.305900 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-140354df-5b95-4eee-b401-5d5cd30cfd54 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:26.306615 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-140354df-5b95-4eee-b401-5d5cd30cfd54 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:26.313068 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-140354df-5b95-4eee-b401-5d5cd30cfd54 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:26.313510 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-140354df-5b95-4eee-b401-5d5cd30cfd54 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:26.314272 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-140354df-5b95-4eee-b401-5d5cd30cfd54 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:26.314725 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-140354df-5b95-4eee-b401-5d5cd30cfd54 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:26.449824 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-140354df-5b95-4eee-b401-5d5cd30cfd54 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:26.456902 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-140354df-5b95-4eee-b401-5d5cd30cfd54 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.154981 Apr 11 13:57:26.458209 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 100/197] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:26 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:27.216441 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5cbfe657-35db-419c-819a-dbf3f4e8fbe5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "POST /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/action" status: 202 len: 0 microversion: 2.20 time: 1.622382 Apr 11 13:57:27.217283 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 98/198] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Apr 11 13:57:25 2022] POST /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/action => generated 0 bytes in 1624 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 13:57:27.228741 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b4febb66-5529-46c7-bd15-6c4029b12114 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:27.229585 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b4febb66-5529-46c7-bd15-6c4029b12114 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:27.238094 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b4febb66-5529-46c7-bd15-6c4029b12114 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:27.239107 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b4febb66-5529-46c7-bd15-6c4029b12114 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:27.240116 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b4febb66-5529-46c7-bd15-6c4029b12114 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:27.240645 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b4febb66-5529-46c7-bd15-6c4029b12114 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:27.426666 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b4febb66-5529-46c7-bd15-6c4029b12114 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:27.435183 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b4febb66-5529-46c7-bd15-6c4029b12114 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:27.436904 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b4febb66-5529-46c7-bd15-6c4029b12114 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:27.438067 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b4febb66-5529-46c7-bd15-6c4029b12114 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.215889 Apr 11 13:57:27.438635 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 101/199] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:27 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:27.475779 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e5583ad1-4520-486f-a909-79af19a8e245 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:27.476952 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e5583ad1-4520-486f-a909-79af19a8e245 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:27.489009 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e5583ad1-4520-486f-a909-79af19a8e245 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:27.489009 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e5583ad1-4520-486f-a909-79af19a8e245 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:27.489009 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e5583ad1-4520-486f-a909-79af19a8e245 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:27.489009 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e5583ad1-4520-486f-a909-79af19a8e245 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:27.685928 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e5583ad1-4520-486f-a909-79af19a8e245 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:27.694041 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e5583ad1-4520-486f-a909-79af19a8e245 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.223368 Apr 11 13:57:27.694877 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 99/200] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:27 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:28.456742 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5b18297a-b12e-4fb4-a38c-eebc3f814247 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:28.458624 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5b18297a-b12e-4fb4-a38c-eebc3f814247 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:28.466271 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5b18297a-b12e-4fb4-a38c-eebc3f814247 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:28.466721 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5b18297a-b12e-4fb4-a38c-eebc3f814247 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:28.467715 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5b18297a-b12e-4fb4-a38c-eebc3f814247 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:28.468409 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5b18297a-b12e-4fb4-a38c-eebc3f814247 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:28.627976 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5b18297a-b12e-4fb4-a38c-eebc3f814247 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:28.639032 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5b18297a-b12e-4fb4-a38c-eebc3f814247 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:28.640571 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5b18297a-b12e-4fb4-a38c-eebc3f814247 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:28.641776 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5b18297a-b12e-4fb4-a38c-eebc3f814247 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.189065 Apr 11 13:57:28.642335 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 102/201] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:28 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:28.712751 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-422aaaac-fd2d-4f23-ac88-44ac09bc5dce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:28.713587 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-422aaaac-fd2d-4f23-ac88-44ac09bc5dce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:28.719616 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-422aaaac-fd2d-4f23-ac88-44ac09bc5dce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:28.720239 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-422aaaac-fd2d-4f23-ac88-44ac09bc5dce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:28.721085 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-422aaaac-fd2d-4f23-ac88-44ac09bc5dce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:28.721598 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-422aaaac-fd2d-4f23-ac88-44ac09bc5dce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:28.861583 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-422aaaac-fd2d-4f23-ac88-44ac09bc5dce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:28.870782 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-422aaaac-fd2d-4f23-ac88-44ac09bc5dce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.163374 Apr 11 13:57:28.871788 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 100/202] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:28 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:29.660350 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-80fe2227-1545-4d6b-99a2-691d2552a3cf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:29.660960 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-80fe2227-1545-4d6b-99a2-691d2552a3cf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:29.667734 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80fe2227-1545-4d6b-99a2-691d2552a3cf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:29.668183 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80fe2227-1545-4d6b-99a2-691d2552a3cf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:29.669237 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80fe2227-1545-4d6b-99a2-691d2552a3cf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:29.669661 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80fe2227-1545-4d6b-99a2-691d2552a3cf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:29.800431 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-80fe2227-1545-4d6b-99a2-691d2552a3cf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:29.808830 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-80fe2227-1545-4d6b-99a2-691d2552a3cf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:29.810579 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-80fe2227-1545-4d6b-99a2-691d2552a3cf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:29.811712 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-80fe2227-1545-4d6b-99a2-691d2552a3cf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.155257 Apr 11 13:57:29.812277 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 103/203] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:29 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:57:29.893777 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4e1589fb-4ac3-4e75-8d5a-43c57b672ace tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:29.893777 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4e1589fb-4ac3-4e75-8d5a-43c57b672ace tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:29.898614 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e1589fb-4ac3-4e75-8d5a-43c57b672ace tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:29.899014 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e1589fb-4ac3-4e75-8d5a-43c57b672ace tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:29.901135 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e1589fb-4ac3-4e75-8d5a-43c57b672ace tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:29.901687 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e1589fb-4ac3-4e75-8d5a-43c57b672ace tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:30.036960 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4e1589fb-4ac3-4e75-8d5a-43c57b672ace tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:30.044471 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4e1589fb-4ac3-4e75-8d5a-43c57b672ace tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.158928 Apr 11 13:57:30.045033 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 101/204] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:29 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:30.670138 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2052713409", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:30.724149 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] validate_networks() for None {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 13:57:30.830842 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e4c49c8d-588b-48f5-87dd-2b403099515f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:30.831381 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e4c49c8d-588b-48f5-87dd-2b403099515f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:30.837238 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e4c49c8d-588b-48f5-87dd-2b403099515f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:30.837694 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e4c49c8d-588b-48f5-87dd-2b403099515f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:30.838474 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e4c49c8d-588b-48f5-87dd-2b403099515f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:30.838916 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e4c49c8d-588b-48f5-87dd-2b403099515f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:30.971134 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e4c49c8d-588b-48f5-87dd-2b403099515f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:30.980802 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e4c49c8d-588b-48f5-87dd-2b403099515f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:30.982323 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e4c49c8d-588b-48f5-87dd-2b403099515f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:30.983489 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e4c49c8d-588b-48f5-87dd-2b403099515f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.156707 Apr 11 13:57:30.984071 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 102/205] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:30 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:57:31.002821 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 13:57:31.003245 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 13:57:31.003837 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 13:57:31.004307 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 13:57:31.004715 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 13:57:31.013364 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:31.013812 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:31.014616 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:31.015054 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:31.031569 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Getting quotas for project 6b883dc95a4349fba7f113cbe48b4c51. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:57:31.036084 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Getting quotas for user 73000e2a51b8452e9e25ecde059ce0a8 and project 6b883dc95a4349fba7f113cbe48b4c51. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:57:31.046908 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 13:57:31.049179 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 13:57:31.061207 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7e3bb1bb-fb04-4008-831d-b117e97a4a10 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:31.061996 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7e3bb1bb-fb04-4008-831d-b117e97a4a10 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:31.068280 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e3bb1bb-fb04-4008-831d-b117e97a4a10 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:31.068729 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e3bb1bb-fb04-4008-831d-b117e97a4a10 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:31.069530 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e3bb1bb-fb04-4008-831d-b117e97a4a10 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:31.069989 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e3bb1bb-fb04-4008-831d-b117e97a4a10 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:31.093233 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-70d18ae4-e17a-41c3-aec2-0064dd70c983 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.428373 Apr 11 13:57:31.093967 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 104/206] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 13:57:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 13:57:31.108270 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-984a6dd1-dda0-4871-9299-d810e0b8a13a tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:31.108893 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-984a6dd1-dda0-4871-9299-d810e0b8a13a tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:31.163901 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-984a6dd1-dda0-4871-9299-d810e0b8a13a tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:31.170976 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-984a6dd1-dda0-4871-9299-d810e0b8a13a tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1215 microversion: 2.1 time: 0.070535 Apr 11 13:57:31.171555 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 105/207] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:31 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:31.209007 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7e3bb1bb-fb04-4008-831d-b117e97a4a10 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:31.216423 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7e3bb1bb-fb04-4008-831d-b117e97a4a10 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1501 microversion: 2.1 time: 0.158935 Apr 11 13:57:31.217003 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 103/208] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:31 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:31.233165 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-413444f1-2cf8-4083-81fc-a4534f79598a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4383c62d-f7ee-4479-815e-734b2f55936b"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:31.234307 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-413444f1-2cf8-4083-81fc-a4534f79598a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:31.240425 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-413444f1-2cf8-4083-81fc-a4534f79598a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:31.240876 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-413444f1-2cf8-4083-81fc-a4534f79598a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:31.241645 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-413444f1-2cf8-4083-81fc-a4534f79598a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:31.242252 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-413444f1-2cf8-4083-81fc-a4534f79598a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:31.265814 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-413444f1-2cf8-4083-81fc-a4534f79598a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] HTTP exception thrown: Cannot 'attach_volume' instance eea0ff31-35c2-4763-bf7a-6d0aada0558c while it is in vm_state rescued Apr 11 13:57:31.266548 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-413444f1-2cf8-4083-81fc-a4534f79598a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Returning 409 to user: Cannot 'attach_volume' instance eea0ff31-35c2-4763-bf7a-6d0aada0558c while it is in vm_state rescued {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:57:31.267496 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-413444f1-2cf8-4083-81fc-a4534f79598a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "POST /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038287 Apr 11 13:57:31.268093 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 106/209] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 13:57:31 2022] POST /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c/os-volume_attachments => generated 152 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 13:57:31.278045 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-96941a38-dcd4-44f6-b909-7b244cca2eb6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:31.278861 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-96941a38-dcd4-44f6-b909-7b244cca2eb6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:31.284919 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-96941a38-dcd4-44f6-b909-7b244cca2eb6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:31.285410 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-96941a38-dcd4-44f6-b909-7b244cca2eb6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:31.286173 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-96941a38-dcd4-44f6-b909-7b244cca2eb6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:31.286607 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-96941a38-dcd4-44f6-b909-7b244cca2eb6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:31.353858 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-96941a38-dcd4-44f6-b909-7b244cca2eb6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "POST /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c/action" status: 202 len: 0 microversion: 2.1 time: 0.079846 Apr 11 13:57:31.354724 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 104/210] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 13:57:31 2022] POST /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 13:57:31.363916 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a79834b7-1766-400e-b56e-724576ee3edd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:31.364710 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a79834b7-1766-400e-b56e-724576ee3edd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:31.371016 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a79834b7-1766-400e-b56e-724576ee3edd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:31.371724 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a79834b7-1766-400e-b56e-724576ee3edd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:31.372864 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a79834b7-1766-400e-b56e-724576ee3edd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:31.373564 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a79834b7-1766-400e-b56e-724576ee3edd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:31.511792 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a79834b7-1766-400e-b56e-724576ee3edd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:31.519031 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a79834b7-1766-400e-b56e-724576ee3edd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1509 microversion: 2.1 time: 0.160250 Apr 11 13:57:31.520195 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 107/211] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:31 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:32.002682 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-74ef6cf5-6a4c-4727-b62b-52360a3d9964 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:32.003392 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-74ef6cf5-6a4c-4727-b62b-52360a3d9964 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:32.010676 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-74ef6cf5-6a4c-4727-b62b-52360a3d9964 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:32.011135 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-74ef6cf5-6a4c-4727-b62b-52360a3d9964 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:32.011943 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-74ef6cf5-6a4c-4727-b62b-52360a3d9964 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:32.012522 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-74ef6cf5-6a4c-4727-b62b-52360a3d9964 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:32.138764 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-74ef6cf5-6a4c-4727-b62b-52360a3d9964 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:32.147488 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-74ef6cf5-6a4c-4727-b62b-52360a3d9964 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:32.149354 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-74ef6cf5-6a4c-4727-b62b-52360a3d9964 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:32.150814 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-74ef6cf5-6a4c-4727-b62b-52360a3d9964 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.152414 Apr 11 13:57:32.151413 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 105/212] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:31 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:32.187945 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5aa31132-ce7f-499f-980c-3c5e01e0e762 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:32.188540 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5aa31132-ce7f-499f-980c-3c5e01e0e762 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:32.194847 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5aa31132-ce7f-499f-980c-3c5e01e0e762 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:32.195297 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5aa31132-ce7f-499f-980c-3c5e01e0e762 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:32.196094 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5aa31132-ce7f-499f-980c-3c5e01e0e762 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:32.196531 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5aa31132-ce7f-499f-980c-3c5e01e0e762 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:32.256810 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5aa31132-ce7f-499f-980c-3c5e01e0e762 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:32.263924 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5aa31132-ce7f-499f-980c-3c5e01e0e762 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1219 microversion: 2.1 time: 0.079852 Apr 11 13:57:32.264492 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 108/213] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:32 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:32.537290 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-897ee813-ce82-43b9-a131-2fdf09f59ee2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:32.537910 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-897ee813-ce82-43b9-a131-2fdf09f59ee2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:32.544002 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-897ee813-ce82-43b9-a131-2fdf09f59ee2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:32.544461 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-897ee813-ce82-43b9-a131-2fdf09f59ee2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:32.545226 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-897ee813-ce82-43b9-a131-2fdf09f59ee2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:32.545672 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-897ee813-ce82-43b9-a131-2fdf09f59ee2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:32.675350 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-897ee813-ce82-43b9-a131-2fdf09f59ee2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:32.682489 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-897ee813-ce82-43b9-a131-2fdf09f59ee2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1509 microversion: 2.1 time: 0.149887 Apr 11 13:57:32.683048 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 106/214] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:32 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:33.170043 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7bb45e94-d5e3-42e2-9992-887de41f060c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:33.170655 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7bb45e94-d5e3-42e2-9992-887de41f060c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:33.176933 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7bb45e94-d5e3-42e2-9992-887de41f060c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:33.177322 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7bb45e94-d5e3-42e2-9992-887de41f060c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:33.178086 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7bb45e94-d5e3-42e2-9992-887de41f060c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:33.178524 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7bb45e94-d5e3-42e2-9992-887de41f060c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:33.281779 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-60932a91-0753-4000-9f05-8ddd1f5807b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:33.282792 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-60932a91-0753-4000-9f05-8ddd1f5807b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:33.289086 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60932a91-0753-4000-9f05-8ddd1f5807b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:33.289628 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60932a91-0753-4000-9f05-8ddd1f5807b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:33.290606 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60932a91-0753-4000-9f05-8ddd1f5807b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:33.291051 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60932a91-0753-4000-9f05-8ddd1f5807b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:33.307676 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7bb45e94-d5e3-42e2-9992-887de41f060c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:33.315497 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7bb45e94-d5e3-42e2-9992-887de41f060c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:33.318006 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7bb45e94-d5e3-42e2-9992-887de41f060c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:33.319170 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7bb45e94-d5e3-42e2-9992-887de41f060c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.153241 Apr 11 13:57:33.319747 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 109/215] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:33 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:33.352190 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-60932a91-0753-4000-9f05-8ddd1f5807b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:33.360454 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-60932a91-0753-4000-9f05-8ddd1f5807b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1219 microversion: 2.1 time: 0.082603 Apr 11 13:57:33.361028 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 107/216] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:33 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:33.699896 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d5540b60-161f-4133-a881-36f9f24c6ee0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:33.700507 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d5540b60-161f-4133-a881-36f9f24c6ee0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:33.706327 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d5540b60-161f-4133-a881-36f9f24c6ee0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:33.706958 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d5540b60-161f-4133-a881-36f9f24c6ee0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:33.707819 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d5540b60-161f-4133-a881-36f9f24c6ee0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:33.708258 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d5540b60-161f-4133-a881-36f9f24c6ee0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:33.830174 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d5540b60-161f-4133-a881-36f9f24c6ee0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:33.837436 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d5540b60-161f-4133-a881-36f9f24c6ee0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1509 microversion: 2.1 time: 0.141407 Apr 11 13:57:33.837998 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 110/217] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:33 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1509 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:34.337542 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-26fa2a4b-e9f8-4481-af66-804cd30ae7a5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:34.338152 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-26fa2a4b-e9f8-4481-af66-804cd30ae7a5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:34.344318 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26fa2a4b-e9f8-4481-af66-804cd30ae7a5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:34.344774 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26fa2a4b-e9f8-4481-af66-804cd30ae7a5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:34.345542 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26fa2a4b-e9f8-4481-af66-804cd30ae7a5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:34.345983 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26fa2a4b-e9f8-4481-af66-804cd30ae7a5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:34.378097 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-96292ac7-fbf5-4fbd-ab41-91697c8a243d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:34.378874 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-96292ac7-fbf5-4fbd-ab41-91697c8a243d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:34.385269 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-96292ac7-fbf5-4fbd-ab41-91697c8a243d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:34.385743 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-96292ac7-fbf5-4fbd-ab41-91697c8a243d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:34.386544 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-96292ac7-fbf5-4fbd-ab41-91697c8a243d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:34.386982 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-96292ac7-fbf5-4fbd-ab41-91697c8a243d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:34.482859 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-26fa2a4b-e9f8-4481-af66-804cd30ae7a5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:34.492622 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-26fa2a4b-e9f8-4481-af66-804cd30ae7a5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:34.494202 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-26fa2a4b-e9f8-4481-af66-804cd30ae7a5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:34.495374 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-26fa2a4b-e9f8-4481-af66-804cd30ae7a5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.161871 Apr 11 13:57:34.496123 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 108/218] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:34 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:34.509394 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-96292ac7-fbf5-4fbd-ab41-91697c8a243d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:34.517305 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-96292ac7-fbf5-4fbd-ab41-91697c8a243d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1273 microversion: 2.1 time: 0.142899 Apr 11 13:57:34.518046 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 111/219] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:34 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:34.854303 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-58daf6fb-ead0-4c1b-96ea-7b3d41ca47ce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:34.854932 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-58daf6fb-ead0-4c1b-96ea-7b3d41ca47ce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:34.860999 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-58daf6fb-ead0-4c1b-96ea-7b3d41ca47ce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:34.861457 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-58daf6fb-ead0-4c1b-96ea-7b3d41ca47ce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:34.862229 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-58daf6fb-ead0-4c1b-96ea-7b3d41ca47ce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:34.863219 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-58daf6fb-ead0-4c1b-96ea-7b3d41ca47ce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:34.993708 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-58daf6fb-ead0-4c1b-96ea-7b3d41ca47ce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:35.002031 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-58daf6fb-ead0-4c1b-96ea-7b3d41ca47ce tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1509 microversion: 2.1 time: 0.151511 Apr 11 13:57:35.002696 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 109/220] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:34 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:35.514130 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-72d31c90-4956-41ce-a279-119ce1f9465c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:35.514874 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-72d31c90-4956-41ce-a279-119ce1f9465c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:35.521905 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-72d31c90-4956-41ce-a279-119ce1f9465c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:35.522439 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-72d31c90-4956-41ce-a279-119ce1f9465c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:35.523279 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-72d31c90-4956-41ce-a279-119ce1f9465c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:35.523940 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-72d31c90-4956-41ce-a279-119ce1f9465c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:35.534444 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f505a316-ef6a-4e42-8227-6a154ec3e29e tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:35.535798 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f505a316-ef6a-4e42-8227-6a154ec3e29e tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:35.542220 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f505a316-ef6a-4e42-8227-6a154ec3e29e tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:35.542672 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f505a316-ef6a-4e42-8227-6a154ec3e29e tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:35.543864 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f505a316-ef6a-4e42-8227-6a154ec3e29e tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:35.544265 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f505a316-ef6a-4e42-8227-6a154ec3e29e tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:35.689989 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f505a316-ef6a-4e42-8227-6a154ec3e29e tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:35.698270 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f505a316-ef6a-4e42-8227-6a154ec3e29e tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1315 microversion: 2.1 time: 0.167809 Apr 11 13:57:35.698934 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 110/221] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:35 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:35.755989 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-72d31c90-4956-41ce-a279-119ce1f9465c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:35.767674 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-72d31c90-4956-41ce-a279-119ce1f9465c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:35.769961 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-72d31c90-4956-41ce-a279-119ce1f9465c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:35.771504 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-72d31c90-4956-41ce-a279-119ce1f9465c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.261318 Apr 11 13:57:35.772348 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 112/222] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:35 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:35.954994 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-c155da47-fe3d-465c-a79f-711de7cc8c53 req-1ae3489e-9257-486d-bf8e-99f736851eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc267f34-a781-49f9-8046-13bb95dfd815", "tag": "66864fa9-4e22-4107-8f15-e9d9fa5c63ec"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:35.964579 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c155da47-fe3d-465c-a79f-711de7cc8c53 req-1ae3489e-9257-486d-bf8e-99f736851eec service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:35.966730 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c155da47-fe3d-465c-a79f-711de7cc8c53 req-1ae3489e-9257-486d-bf8e-99f736851eec service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:35.986465 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-c155da47-fe3d-465c-a79f-711de7cc8c53 req-1ae3489e-9257-486d-bf8e-99f736851eec service nova] Creating event network-changed:66864fa9-4e22-4107-8f15-e9d9fa5c63ec for instance bc267f34-a781-49f9-8046-13bb95dfd815 on hv-cinder-83078 Apr 11 13:57:35.992595 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-c155da47-fe3d-465c-a79f-711de7cc8c53 req-1ae3489e-9257-486d-bf8e-99f736851eec service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040397 Apr 11 13:57:35.993764 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 111/223] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:57:36.020550 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-06668ffc-e94b-4e63-ae36-57ac06e5e864 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:36.021337 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-06668ffc-e94b-4e63-ae36-57ac06e5e864 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:36.028576 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06668ffc-e94b-4e63-ae36-57ac06e5e864 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:36.029050 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06668ffc-e94b-4e63-ae36-57ac06e5e864 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:36.029897 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06668ffc-e94b-4e63-ae36-57ac06e5e864 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:36.030369 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06668ffc-e94b-4e63-ae36-57ac06e5e864 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:36.165727 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-06668ffc-e94b-4e63-ae36-57ac06e5e864 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:36.173310 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-06668ffc-e94b-4e63-ae36-57ac06e5e864 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1509 microversion: 2.1 time: 0.157579 Apr 11 13:57:36.173878 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 113/224] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:36 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:36.716899 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9676c1f2-c5af-46f1-ad46-71a458bb1b20 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:36.717714 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9676c1f2-c5af-46f1-ad46-71a458bb1b20 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:36.723807 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9676c1f2-c5af-46f1-ad46-71a458bb1b20 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:36.724261 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9676c1f2-c5af-46f1-ad46-71a458bb1b20 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:36.725031 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9676c1f2-c5af-46f1-ad46-71a458bb1b20 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:36.725577 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9676c1f2-c5af-46f1-ad46-71a458bb1b20 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:36.790380 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a55ad01f-cdb7-47ac-acc9-edc8e04e783a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:36.790989 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a55ad01f-cdb7-47ac-acc9-edc8e04e783a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:36.797984 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a55ad01f-cdb7-47ac-acc9-edc8e04e783a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:36.798429 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a55ad01f-cdb7-47ac-acc9-edc8e04e783a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:36.799198 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a55ad01f-cdb7-47ac-acc9-edc8e04e783a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:36.799653 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a55ad01f-cdb7-47ac-acc9-edc8e04e783a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:36.898677 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9676c1f2-c5af-46f1-ad46-71a458bb1b20 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:36.906638 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9676c1f2-c5af-46f1-ad46-71a458bb1b20 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1315 microversion: 2.1 time: 0.193806 Apr 11 13:57:36.907248 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 112/225] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:36 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:37.187978 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a55ad01f-cdb7-47ac-acc9-edc8e04e783a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:37.190502 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-943bb3f9-3880-43a4-9f31-4034374855fd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:37.191605 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-943bb3f9-3880-43a4-9f31-4034374855fd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:37.195937 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a55ad01f-cdb7-47ac-acc9-edc8e04e783a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:37.197436 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a55ad01f-cdb7-47ac-acc9-edc8e04e783a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:37.197866 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-943bb3f9-3880-43a4-9f31-4034374855fd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:37.198189 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-943bb3f9-3880-43a4-9f31-4034374855fd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:37.198598 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a55ad01f-cdb7-47ac-acc9-edc8e04e783a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.412180 Apr 11 13:57:37.199099 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-943bb3f9-3880-43a4-9f31-4034374855fd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:37.200188 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-943bb3f9-3880-43a4-9f31-4034374855fd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:37.208969 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 114/226] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:36 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:57:37.332478 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-943bb3f9-3880-43a4-9f31-4034374855fd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:37.339841 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-943bb3f9-3880-43a4-9f31-4034374855fd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1509 microversion: 2.1 time: 0.153141 Apr 11 13:57:37.340399 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 113/227] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:37 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:37.923875 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c9accc7c-ecad-4b9d-82f0-ab09b58097e6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:37.924497 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c9accc7c-ecad-4b9d-82f0-ab09b58097e6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:37.931795 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9accc7c-ecad-4b9d-82f0-ab09b58097e6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:37.932244 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9accc7c-ecad-4b9d-82f0-ab09b58097e6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:37.933013 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9accc7c-ecad-4b9d-82f0-ab09b58097e6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:37.933445 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9accc7c-ecad-4b9d-82f0-ab09b58097e6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:38.063040 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c9accc7c-ecad-4b9d-82f0-ab09b58097e6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:38.071134 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c9accc7c-ecad-4b9d-82f0-ab09b58097e6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1315 microversion: 2.1 time: 0.151066 Apr 11 13:57:38.071978 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 115/228] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:37 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:38.217629 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-26a9c8e8-9c48-421b-ac8a-7f20e6a4b33b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:38.218934 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-26a9c8e8-9c48-421b-ac8a-7f20e6a4b33b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:38.225787 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26a9c8e8-9c48-421b-ac8a-7f20e6a4b33b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:38.226339 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26a9c8e8-9c48-421b-ac8a-7f20e6a4b33b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:38.227458 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26a9c8e8-9c48-421b-ac8a-7f20e6a4b33b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:38.228035 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26a9c8e8-9c48-421b-ac8a-7f20e6a4b33b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:38.357538 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b2c0a4aa-3d36-48a2-a85c-c9caef2cb640 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:38.357538 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b2c0a4aa-3d36-48a2-a85c-c9caef2cb640 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:38.364134 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2c0a4aa-3d36-48a2-a85c-c9caef2cb640 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:38.364656 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2c0a4aa-3d36-48a2-a85c-c9caef2cb640 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:38.365483 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2c0a4aa-3d36-48a2-a85c-c9caef2cb640 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:38.365976 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2c0a4aa-3d36-48a2-a85c-c9caef2cb640 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:38.441081 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-26a9c8e8-9c48-421b-ac8a-7f20e6a4b33b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:38.450257 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-26a9c8e8-9c48-421b-ac8a-7f20e6a4b33b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:38.453033 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-26a9c8e8-9c48-421b-ac8a-7f20e6a4b33b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:38.454486 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-26a9c8e8-9c48-421b-ac8a-7f20e6a4b33b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.240891 Apr 11 13:57:38.455478 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 114/229] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:38 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:38.522276 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b2c0a4aa-3d36-48a2-a85c-c9caef2cb640 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:38.532130 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b2c0a4aa-3d36-48a2-a85c-c9caef2cb640 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1509 microversion: 2.1 time: 0.179071 Apr 11 13:57:38.532925 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 116/230] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:38 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:39.088661 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-80d1fa20-9424-47d3-b853-9c143bba92cd tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:39.089513 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-80d1fa20-9424-47d3-b853-9c143bba92cd tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:39.095326 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-80d1fa20-9424-47d3-b853-9c143bba92cd tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:39.095989 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-80d1fa20-9424-47d3-b853-9c143bba92cd tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:39.097549 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-80d1fa20-9424-47d3-b853-9c143bba92cd tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:39.098147 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-80d1fa20-9424-47d3-b853-9c143bba92cd tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:39.300777 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-80d1fa20-9424-47d3-b853-9c143bba92cd tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:39.309587 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-80d1fa20-9424-47d3-b853-9c143bba92cd tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1315 microversion: 2.1 time: 0.224569 Apr 11 13:57:39.310178 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 115/231] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:39 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:39.474765 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-71a16a5f-919f-4ee0-83b0-24f278e84fcb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:39.475871 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-71a16a5f-919f-4ee0-83b0-24f278e84fcb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:39.482605 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71a16a5f-919f-4ee0-83b0-24f278e84fcb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:39.483173 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71a16a5f-919f-4ee0-83b0-24f278e84fcb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:39.484230 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71a16a5f-919f-4ee0-83b0-24f278e84fcb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:39.484916 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71a16a5f-919f-4ee0-83b0-24f278e84fcb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:39.551280 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-604ccd81-53af-4460-8eeb-97c1bb2eb976 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:39.552654 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-604ccd81-53af-4460-8eeb-97c1bb2eb976 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:39.562024 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-604ccd81-53af-4460-8eeb-97c1bb2eb976 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:39.562892 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-604ccd81-53af-4460-8eeb-97c1bb2eb976 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:39.564056 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-604ccd81-53af-4460-8eeb-97c1bb2eb976 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:39.564604 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-604ccd81-53af-4460-8eeb-97c1bb2eb976 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:39.725659 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-71a16a5f-919f-4ee0-83b0-24f278e84fcb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:39.735249 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-71a16a5f-919f-4ee0-83b0-24f278e84fcb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:39.736698 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-71a16a5f-919f-4ee0-83b0-24f278e84fcb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:39.738482 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-71a16a5f-919f-4ee0-83b0-24f278e84fcb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.268473 Apr 11 13:57:39.739041 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 117/232] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:39 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:39.805228 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-604ccd81-53af-4460-8eeb-97c1bb2eb976 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:39.812748 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-604ccd81-53af-4460-8eeb-97c1bb2eb976 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1509 microversion: 2.1 time: 0.266286 Apr 11 13:57:39.813404 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 116/233] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:39 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1509 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:40.326246 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fe348010-2b37-4290-9f60-59253d0beb0a tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:40.326951 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fe348010-2b37-4290-9f60-59253d0beb0a tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:40.341358 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fe348010-2b37-4290-9f60-59253d0beb0a tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:40.342009 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fe348010-2b37-4290-9f60-59253d0beb0a tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:40.342891 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fe348010-2b37-4290-9f60-59253d0beb0a tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:40.343399 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fe348010-2b37-4290-9f60-59253d0beb0a tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:40.621292 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fe348010-2b37-4290-9f60-59253d0beb0a tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:40.629317 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fe348010-2b37-4290-9f60-59253d0beb0a tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1315 microversion: 2.1 time: 0.306900 Apr 11 13:57:40.630231 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 118/234] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:40 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:40.757966 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-59b5b87e-e43c-495d-98cc-518d77942be9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:40.758614 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-59b5b87e-e43c-495d-98cc-518d77942be9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:40.767219 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59b5b87e-e43c-495d-98cc-518d77942be9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:40.770407 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59b5b87e-e43c-495d-98cc-518d77942be9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:40.771469 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59b5b87e-e43c-495d-98cc-518d77942be9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:40.773793 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59b5b87e-e43c-495d-98cc-518d77942be9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:40.830238 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8382ec63-e980-4c15-af93-d6dde0e56d83 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:40.830897 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8382ec63-e980-4c15-af93-d6dde0e56d83 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:40.837705 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8382ec63-e980-4c15-af93-d6dde0e56d83 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:40.838358 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8382ec63-e980-4c15-af93-d6dde0e56d83 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:40.839403 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8382ec63-e980-4c15-af93-d6dde0e56d83 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:40.840005 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8382ec63-e980-4c15-af93-d6dde0e56d83 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:40.993965 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8382ec63-e980-4c15-af93-d6dde0e56d83 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:41.002834 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8382ec63-e980-4c15-af93-d6dde0e56d83 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1515 microversion: 2.1 time: 0.176284 Apr 11 13:57:41.007676 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 119/235] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:40 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:41.037389 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-59b5b87e-e43c-495d-98cc-518d77942be9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:41.047158 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-59b5b87e-e43c-495d-98cc-518d77942be9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:41.048797 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-59b5b87e-e43c-495d-98cc-518d77942be9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:41.050887 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-59b5b87e-e43c-495d-98cc-518d77942be9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.297822 Apr 11 13:57:41.052076 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 117/236] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:40 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:41.648261 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-31d1965c-e137-4246-a2df-78ab684bbfd0 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:41.654846 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-31d1965c-e137-4246-a2df-78ab684bbfd0 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:41.665481 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31d1965c-e137-4246-a2df-78ab684bbfd0 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:41.666193 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31d1965c-e137-4246-a2df-78ab684bbfd0 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:41.678069 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31d1965c-e137-4246-a2df-78ab684bbfd0 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:41.678537 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31d1965c-e137-4246-a2df-78ab684bbfd0 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:41.885745 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-31d1965c-e137-4246-a2df-78ab684bbfd0 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:41.896996 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-31d1965c-e137-4246-a2df-78ab684bbfd0 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1315 microversion: 2.1 time: 0.253968 Apr 11 13:57:41.906259 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 120/237] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:41 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:42.070216 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c1a38d7e-93fc-469b-b9d5-ad5ac9304d2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:42.071899 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c1a38d7e-93fc-469b-b9d5-ad5ac9304d2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:42.080273 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c1a38d7e-93fc-469b-b9d5-ad5ac9304d2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:42.082741 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c1a38d7e-93fc-469b-b9d5-ad5ac9304d2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:42.083970 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c1a38d7e-93fc-469b-b9d5-ad5ac9304d2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:42.084603 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c1a38d7e-93fc-469b-b9d5-ad5ac9304d2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:42.338837 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c1a38d7e-93fc-469b-b9d5-ad5ac9304d2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:42.349743 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c1a38d7e-93fc-469b-b9d5-ad5ac9304d2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:42.351668 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c1a38d7e-93fc-469b-b9d5-ad5ac9304d2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:42.353131 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c1a38d7e-93fc-469b-b9d5-ad5ac9304d2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.288578 Apr 11 13:57:42.364824 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 118/238] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:42 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:42.502024 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-19c88bd3-27f1-42cd-95a4-9dff940011db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Action: 'create', calling method: .version_select at 0x7f73073d9820>, body: {"keypair": {"name": "tempest-keypair-411134286"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:42.560303 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-19c88bd3-27f1-42cd-95a4-9dff940011db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Getting quotas for project 7e9487af89de4df6b7592a993fc4827e. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:57:42.566446 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-19c88bd3-27f1-42cd-95a4-9dff940011db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Getting quotas for user cfe3f01cd2f742f4903ed97da6b6923c and project 7e9487af89de4df6b7592a993fc4827e. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:57:42.914462 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b6972b13-760d-4a0b-a2f9-74f93e1b00d6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:42.915457 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b6972b13-760d-4a0b-a2f9-74f93e1b00d6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:42.916566 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-19c88bd3-27f1-42cd-95a4-9dff940011db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Getting quotas for project 7e9487af89de4df6b7592a993fc4827e. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:57:42.922623 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-19c88bd3-27f1-42cd-95a4-9dff940011db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Getting quotas for user cfe3f01cd2f742f4903ed97da6b6923c and project 7e9487af89de4df6b7592a993fc4827e. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:57:42.928734 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b6972b13-760d-4a0b-a2f9-74f93e1b00d6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:42.941426 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b6972b13-760d-4a0b-a2f9-74f93e1b00d6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:42.942950 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b6972b13-760d-4a0b-a2f9-74f93e1b00d6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:42.944731 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-19c88bd3-27f1-42cd-95a4-9dff940011db tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.446632 Apr 11 13:57:42.945744 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b6972b13-760d-4a0b-a2f9-74f93e1b00d6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:42.949434 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 121/239] 10.222.0.67 () {60 vars in 1157 bytes} [Mon Apr 11 13:57:42 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:43.242095 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b6972b13-760d-4a0b-a2f9-74f93e1b00d6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:43.251914 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b6972b13-760d-4a0b-a2f9-74f93e1b00d6 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1315 microversion: 2.1 time: 0.341321 Apr 11 13:57:43.254098 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 119/240] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:42 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:43.373149 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5f88b15b-c4a4-42e4-aa5f-721ae7ddb205 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:43.373774 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5f88b15b-c4a4-42e4-aa5f-721ae7ddb205 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:43.387617 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f88b15b-c4a4-42e4-aa5f-721ae7ddb205 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:43.388200 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f88b15b-c4a4-42e4-aa5f-721ae7ddb205 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:43.388877 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f88b15b-c4a4-42e4-aa5f-721ae7ddb205 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:43.394334 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f88b15b-c4a4-42e4-aa5f-721ae7ddb205 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:43.633721 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5f88b15b-c4a4-42e4-aa5f-721ae7ddb205 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:43.643730 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5f88b15b-c4a4-42e4-aa5f-721ae7ddb205 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:43.646014 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5f88b15b-c4a4-42e4-aa5f-721ae7ddb205 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:43.647149 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5f88b15b-c4a4-42e4-aa5f-721ae7ddb205 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.278841 Apr 11 13:57:43.647738 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 122/241] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:43 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:44.274915 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0f93d462-0ce4-4973-a862-a2c9cb07e345 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:44.276280 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0f93d462-0ce4-4973-a862-a2c9cb07e345 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:44.293235 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f93d462-0ce4-4973-a862-a2c9cb07e345 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:44.293820 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f93d462-0ce4-4973-a862-a2c9cb07e345 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:44.302317 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f93d462-0ce4-4973-a862-a2c9cb07e345 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:44.303121 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f93d462-0ce4-4973-a862-a2c9cb07e345 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:44.527389 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0f93d462-0ce4-4973-a862-a2c9cb07e345 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:44.537815 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0f93d462-0ce4-4973-a862-a2c9cb07e345 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1315 microversion: 2.1 time: 0.270872 Apr 11 13:57:44.538940 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 120/242] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:44 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:44.667259 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-03be9d91-fed7-4df6-8eac-4a22758bfb51 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:44.669109 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-03be9d91-fed7-4df6-8eac-4a22758bfb51 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:44.676502 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-03be9d91-fed7-4df6-8eac-4a22758bfb51 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:44.677297 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-03be9d91-fed7-4df6-8eac-4a22758bfb51 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:44.679255 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-03be9d91-fed7-4df6-8eac-4a22758bfb51 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:44.680221 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-03be9d91-fed7-4df6-8eac-4a22758bfb51 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:44.912591 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-03be9d91-fed7-4df6-8eac-4a22758bfb51 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:44.921774 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-03be9d91-fed7-4df6-8eac-4a22758bfb51 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:44.923848 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-03be9d91-fed7-4df6-8eac-4a22758bfb51 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:44.925962 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-03be9d91-fed7-4df6-8eac-4a22758bfb51 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.263195 Apr 11 13:57:44.928329 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 123/243] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:44 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:44.958195 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-300641223", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b366c5b-a29e-42a6-8ecc-0cc9ff2fdbc0"}], "security_groups": [{"name": "tempest-securitygroup--250268317"}], "key_name": "tempest-keypair-411134286", "user_data": "}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:45.342597 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] validate_networks() for [('5b366c5b-a29e-42a6-8ecc-0cc9ff2fdbc0', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 13:57:45.554114 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dfc41063-0349-4906-9de8-61ce5ab90251 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:45.554729 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dfc41063-0349-4906-9de8-61ce5ab90251 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:45.560505 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dfc41063-0349-4906-9de8-61ce5ab90251 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:45.561136 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dfc41063-0349-4906-9de8-61ce5ab90251 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:45.562102 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dfc41063-0349-4906-9de8-61ce5ab90251 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:45.562701 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dfc41063-0349-4906-9de8-61ce5ab90251 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:45.720581 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dfc41063-0349-4906-9de8-61ce5ab90251 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:45.736629 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dfc41063-0349-4906-9de8-61ce5ab90251 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1315 microversion: 2.1 time: 0.186168 Apr 11 13:57:45.737985 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 124/244] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:45 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:45.945643 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f5eb6134-2a58-40e7-ac45-9d08ded21dd0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:45.946541 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f5eb6134-2a58-40e7-ac45-9d08ded21dd0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:45.952452 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f5eb6134-2a58-40e7-ac45-9d08ded21dd0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:45.952901 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f5eb6134-2a58-40e7-ac45-9d08ded21dd0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:45.953676 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f5eb6134-2a58-40e7-ac45-9d08ded21dd0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:45.954460 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f5eb6134-2a58-40e7-ac45-9d08ded21dd0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:46.012377 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 13:57:46.013450 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 13:57:46.014277 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 13:57:46.015417 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 13:57:46.016065 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 13:57:46.029306 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:46.030016 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:46.030989 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:46.033029 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:46.063953 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Getting quotas for project 7e9487af89de4df6b7592a993fc4827e. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:57:46.069659 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Getting quotas for user cfe3f01cd2f742f4903ed97da6b6923c and project 7e9487af89de4df6b7592a993fc4827e. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:57:46.085345 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 13:57:46.087814 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 13:57:46.106311 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f5eb6134-2a58-40e7-ac45-9d08ded21dd0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:46.115005 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f5eb6134-2a58-40e7-ac45-9d08ded21dd0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:46.116781 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f5eb6134-2a58-40e7-ac45-9d08ded21dd0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:46.118898 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f5eb6134-2a58-40e7-ac45-9d08ded21dd0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1744 microversion: 2.20 time: 0.176490 Apr 11 13:57:46.119694 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 125/245] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:45 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:57:46.153189 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e6216388-3208-4ddf-8b64-a915ba4eb4cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.200963 Apr 11 13:57:46.154166 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 121/246] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 13:57:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 11 13:57:46.164251 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-953f6a02-69c6-4236-8ca2-654fe122d4a8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:46.164873 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-953f6a02-69c6-4236-8ca2-654fe122d4a8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:46.305379 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-953f6a02-69c6-4236-8ca2-654fe122d4a8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:46.313342 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-953f6a02-69c6-4236-8ca2-654fe122d4a8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1244 microversion: 2.1 time: 0.152816 Apr 11 13:57:46.315968 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 126/247] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:46 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1244 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:46.757028 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-62527fbb-18b6-4e53-a8d0-94bef0047ce3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:46.757700 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-62527fbb-18b6-4e53-a8d0-94bef0047ce3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:46.770145 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62527fbb-18b6-4e53-a8d0-94bef0047ce3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:46.771944 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62527fbb-18b6-4e53-a8d0-94bef0047ce3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:46.773595 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62527fbb-18b6-4e53-a8d0-94bef0047ce3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:46.775727 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62527fbb-18b6-4e53-a8d0-94bef0047ce3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:47.060860 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-62527fbb-18b6-4e53-a8d0-94bef0047ce3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:47.069348 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-62527fbb-18b6-4e53-a8d0-94bef0047ce3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1315 microversion: 2.1 time: 0.318161 Apr 11 13:57:47.069930 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 122/248] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:46 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:47.138682 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-89b8e243-14a9-4d35-9b8e-6ed7b08b4fd9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:47.139370 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-89b8e243-14a9-4d35-9b8e-6ed7b08b4fd9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:47.152390 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-89b8e243-14a9-4d35-9b8e-6ed7b08b4fd9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:47.153552 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-89b8e243-14a9-4d35-9b8e-6ed7b08b4fd9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:47.157755 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-89b8e243-14a9-4d35-9b8e-6ed7b08b4fd9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:47.159578 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-89b8e243-14a9-4d35-9b8e-6ed7b08b4fd9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:47.330907 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6e155797-c71e-4c4a-9d84-6b99c85d35b8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:47.332026 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6e155797-c71e-4c4a-9d84-6b99c85d35b8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:47.338557 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e155797-c71e-4c4a-9d84-6b99c85d35b8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:47.339204 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e155797-c71e-4c4a-9d84-6b99c85d35b8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:47.340325 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e155797-c71e-4c4a-9d84-6b99c85d35b8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:47.340949 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e155797-c71e-4c4a-9d84-6b99c85d35b8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:47.456321 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6e155797-c71e-4c4a-9d84-6b99c85d35b8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:47.465111 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6e155797-c71e-4c4a-9d84-6b99c85d35b8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1248 microversion: 2.1 time: 0.138439 Apr 11 13:57:47.474955 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 123/249] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:47 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1248 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:47.555554 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-89b8e243-14a9-4d35-9b8e-6ed7b08b4fd9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:47.565872 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-89b8e243-14a9-4d35-9b8e-6ed7b08b4fd9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:47.574229 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-89b8e243-14a9-4d35-9b8e-6ed7b08b4fd9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:47.577402 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-89b8e243-14a9-4d35-9b8e-6ed7b08b4fd9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1744 microversion: 2.20 time: 0.441344 Apr 11 13:57:47.580454 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 127/250] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:47 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1744 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:48.101082 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f76e2901-480b-449f-97e3-7efe60f1fa6b tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:48.102289 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f76e2901-480b-449f-97e3-7efe60f1fa6b tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:48.112369 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f76e2901-480b-449f-97e3-7efe60f1fa6b tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:48.116640 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f76e2901-480b-449f-97e3-7efe60f1fa6b tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:48.118709 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f76e2901-480b-449f-97e3-7efe60f1fa6b tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:48.119501 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f76e2901-480b-449f-97e3-7efe60f1fa6b tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:48.411277 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f76e2901-480b-449f-97e3-7efe60f1fa6b tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:48.423733 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f76e2901-480b-449f-97e3-7efe60f1fa6b tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1315 microversion: 2.1 time: 0.340931 Apr 11 13:57:48.434985 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 124/251] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:48 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:48.482028 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dd48f4fa-5f75-492b-a247-e662ceae8ba1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:48.482644 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dd48f4fa-5f75-492b-a247-e662ceae8ba1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:48.498950 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd48f4fa-5f75-492b-a247-e662ceae8ba1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:48.499404 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd48f4fa-5f75-492b-a247-e662ceae8ba1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:48.500234 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd48f4fa-5f75-492b-a247-e662ceae8ba1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:48.500666 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd48f4fa-5f75-492b-a247-e662ceae8ba1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:48.601190 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f49aee88-1f70-44ae-8d91-35a1afd43f89 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:48.602150 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f49aee88-1f70-44ae-8d91-35a1afd43f89 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:48.610982 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f49aee88-1f70-44ae-8d91-35a1afd43f89 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:48.615831 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f49aee88-1f70-44ae-8d91-35a1afd43f89 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:48.617094 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f49aee88-1f70-44ae-8d91-35a1afd43f89 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:48.617713 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f49aee88-1f70-44ae-8d91-35a1afd43f89 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:48.761889 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dd48f4fa-5f75-492b-a247-e662ceae8ba1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:48.776990 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dd48f4fa-5f75-492b-a247-e662ceae8ba1 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1314 microversion: 2.1 time: 0.298648 Apr 11 13:57:48.777575 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 128/252] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:48 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:48.873704 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f49aee88-1f70-44ae-8d91-35a1afd43f89 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:48.886730 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f49aee88-1f70-44ae-8d91-35a1afd43f89 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:48.886730 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f49aee88-1f70-44ae-8d91-35a1afd43f89 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:48.888167 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f49aee88-1f70-44ae-8d91-35a1afd43f89 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1744 microversion: 2.20 time: 0.293650 Apr 11 13:57:48.899367 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 125/253] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:48 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1744 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:57:49.321702 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-3887e4f7-13b2-455d-8fd8-1635958d94d0 req-aa7778bb-f87b-4dfe-b116-5890d20b7886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc267f34-a781-49f9-8046-13bb95dfd815", "name": "network-vif-plugged", "status": "completed", "tag": "66864fa9-4e22-4107-8f15-e9d9fa5c63ec"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:49.343267 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-3887e4f7-13b2-455d-8fd8-1635958d94d0 req-aa7778bb-f87b-4dfe-b116-5890d20b7886 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:49.343772 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-3887e4f7-13b2-455d-8fd8-1635958d94d0 req-aa7778bb-f87b-4dfe-b116-5890d20b7886 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:49.381621 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-3887e4f7-13b2-455d-8fd8-1635958d94d0 req-aa7778bb-f87b-4dfe-b116-5890d20b7886 service nova] Creating event network-vif-plugged:66864fa9-4e22-4107-8f15-e9d9fa5c63ec for instance bc267f34-a781-49f9-8046-13bb95dfd815 on hv-cinder-83078 Apr 11 13:57:49.389183 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-3887e4f7-13b2-455d-8fd8-1635958d94d0 req-aa7778bb-f87b-4dfe-b116-5890d20b7886 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071928 Apr 11 13:57:49.389794 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 129/254] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:57:49.443671 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8ef0645f-184c-4954-90d7-b61d6f26a275 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:49.446150 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8ef0645f-184c-4954-90d7-b61d6f26a275 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:49.462654 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ef0645f-184c-4954-90d7-b61d6f26a275 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:49.463807 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ef0645f-184c-4954-90d7-b61d6f26a275 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:49.478688 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ef0645f-184c-4954-90d7-b61d6f26a275 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:49.479370 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ef0645f-184c-4954-90d7-b61d6f26a275 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:49.742681 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8ef0645f-184c-4954-90d7-b61d6f26a275 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:49.753571 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8ef0645f-184c-4954-90d7-b61d6f26a275 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1315 microversion: 2.1 time: 0.314990 Apr 11 13:57:49.754953 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 126/255] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:49 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:49.796082 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-384516d7-c7b5-4b05-8639-3381335f8ee8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:49.796894 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-384516d7-c7b5-4b05-8639-3381335f8ee8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:49.807893 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-384516d7-c7b5-4b05-8639-3381335f8ee8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:49.810085 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-384516d7-c7b5-4b05-8639-3381335f8ee8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:49.811013 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-384516d7-c7b5-4b05-8639-3381335f8ee8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:49.812169 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-384516d7-c7b5-4b05-8639-3381335f8ee8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:49.906327 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2a9f44fc-aa92-40dd-ba8c-28666280602d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:49.906958 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2a9f44fc-aa92-40dd-ba8c-28666280602d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:49.914594 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a9f44fc-aa92-40dd-ba8c-28666280602d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:49.915306 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a9f44fc-aa92-40dd-ba8c-28666280602d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:49.916352 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a9f44fc-aa92-40dd-ba8c-28666280602d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:49.916980 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a9f44fc-aa92-40dd-ba8c-28666280602d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:50.076989 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2a9f44fc-aa92-40dd-ba8c-28666280602d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:50.086559 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2a9f44fc-aa92-40dd-ba8c-28666280602d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:50.089928 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2a9f44fc-aa92-40dd-ba8c-28666280602d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:50.091154 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2a9f44fc-aa92-40dd-ba8c-28666280602d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1744 microversion: 2.20 time: 0.188755 Apr 11 13:57:50.091920 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 127/256] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:49 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:57:50.181770 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-384516d7-c7b5-4b05-8639-3381335f8ee8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:50.191977 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-384516d7-c7b5-4b05-8639-3381335f8ee8 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1302 microversion: 2.1 time: 0.400758 Apr 11 13:57:50.203255 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 130/257] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:49 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1302 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:50.771512 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bfdaa35d-887c-4a25-9996-43cf6d298bde tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:50.773427 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bfdaa35d-887c-4a25-9996-43cf6d298bde tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:50.792765 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bfdaa35d-887c-4a25-9996-43cf6d298bde tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:50.794482 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bfdaa35d-887c-4a25-9996-43cf6d298bde tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:50.799903 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bfdaa35d-887c-4a25-9996-43cf6d298bde tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:50.802026 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bfdaa35d-887c-4a25-9996-43cf6d298bde tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:51.110232 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d8e94718-85ac-4131-9e39-3b3940cbde79 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:51.110851 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d8e94718-85ac-4131-9e39-3b3940cbde79 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:51.123318 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8e94718-85ac-4131-9e39-3b3940cbde79 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:51.124683 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8e94718-85ac-4131-9e39-3b3940cbde79 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:51.125817 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8e94718-85ac-4131-9e39-3b3940cbde79 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:51.126310 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8e94718-85ac-4131-9e39-3b3940cbde79 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:51.195741 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-bfdaa35d-887c-4a25-9996-43cf6d298bde tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:51.212061 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bfdaa35d-887c-4a25-9996-43cf6d298bde tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1315 microversion: 2.1 time: 0.445475 Apr 11 13:57:51.212643 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 128/258] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:50 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:51.233950 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f1df5973-6b57-4d9d-a595-b806d4d860f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:51.235045 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f1df5973-6b57-4d9d-a595-b806d4d860f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:51.242702 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1df5973-6b57-4d9d-a595-b806d4d860f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:51.243353 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1df5973-6b57-4d9d-a595-b806d4d860f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:51.246224 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1df5973-6b57-4d9d-a595-b806d4d860f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:51.246840 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1df5973-6b57-4d9d-a595-b806d4d860f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:51.545016 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d8e94718-85ac-4131-9e39-3b3940cbde79 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:51.559894 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d8e94718-85ac-4131-9e39-3b3940cbde79 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:51.565473 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d8e94718-85ac-4131-9e39-3b3940cbde79 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:51.567662 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d8e94718-85ac-4131-9e39-3b3940cbde79 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.460692 Apr 11 13:57:51.573086 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 131/259] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:51 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:57:51.586650 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-6ca36d29-fb5b-45ad-b508-f40d7b91e19b req-91b15fd5-f159-4e3d-94d3-3cc9d65f2b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5f3b7d-8b92-4264-b41a-1d1ade879f2f", "name": "network-vif-plugged", "status": "completed", "tag": "cda04f4a-80ef-4c18-b575-cb87293272ce"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:51.607752 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-6ca36d29-fb5b-45ad-b508-f40d7b91e19b req-91b15fd5-f159-4e3d-94d3-3cc9d65f2b3d service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:51.609442 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-6ca36d29-fb5b-45ad-b508-f40d7b91e19b req-91b15fd5-f159-4e3d-94d3-3cc9d65f2b3d service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:51.656880 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-6ca36d29-fb5b-45ad-b508-f40d7b91e19b req-91b15fd5-f159-4e3d-94d3-3cc9d65f2b3d service nova] Creating event network-vif-plugged:cda04f4a-80ef-4c18-b575-cb87293272ce for instance 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f on hv-cinder-83078 Apr 11 13:57:51.681574 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-6ca36d29-fb5b-45ad-b508-f40d7b91e19b req-91b15fd5-f159-4e3d-94d3-3cc9d65f2b3d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101510 Apr 11 13:57:51.683937 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 132/260] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:57:51.728778 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f1df5973-6b57-4d9d-a595-b806d4d860f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:51.737741 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f1df5973-6b57-4d9d-a595-b806d4d860f2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1369 microversion: 2.1 time: 0.521611 Apr 11 13:57:51.746665 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 129/261] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:51 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1369 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:52.230004 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d476bca5-2759-4731-ab12-c9aea74bd1fa tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:52.230856 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d476bca5-2759-4731-ab12-c9aea74bd1fa tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:52.240226 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d476bca5-2759-4731-ab12-c9aea74bd1fa tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:52.248676 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d476bca5-2759-4731-ab12-c9aea74bd1fa tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:52.253671 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d476bca5-2759-4731-ab12-c9aea74bd1fa tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:52.254275 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d476bca5-2759-4731-ab12-c9aea74bd1fa tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:52.406437 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-1d38958f-d32d-4912-ab26-098e133b4ef5 req-04cf1502-1a0b-424a-b3b3-ca525d832ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b122bc-5193-4642-9f21-0e30c573c88e", "tag": "dd31c02f-d45d-4905-89c8-0c0d76d81cb0"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:52.435156 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-1d38958f-d32d-4912-ab26-098e133b4ef5 req-04cf1502-1a0b-424a-b3b3-ca525d832ce7 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:52.436011 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-1d38958f-d32d-4912-ab26-098e133b4ef5 req-04cf1502-1a0b-424a-b3b3-ca525d832ce7 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:52.457789 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-1d38958f-d32d-4912-ab26-098e133b4ef5 req-04cf1502-1a0b-424a-b3b3-ca525d832ce7 service nova] Creating event network-changed:dd31c02f-d45d-4905-89c8-0c0d76d81cb0 for instance a1b122bc-5193-4642-9f21-0e30c573c88e on hv-cinder-83078 Apr 11 13:57:52.464286 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-1d38958f-d32d-4912-ab26-098e133b4ef5 req-04cf1502-1a0b-424a-b3b3-ca525d832ce7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061353 Apr 11 13:57:52.465776 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 130/262] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:57:52.599463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9f55140f-db3f-4039-bb62-5c9cf07293fc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:52.600334 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9f55140f-db3f-4039-bb62-5c9cf07293fc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:52.609765 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f55140f-db3f-4039-bb62-5c9cf07293fc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:52.612053 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f55140f-db3f-4039-bb62-5c9cf07293fc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:52.614330 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f55140f-db3f-4039-bb62-5c9cf07293fc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:52.615870 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f55140f-db3f-4039-bb62-5c9cf07293fc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:52.850935 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d476bca5-2759-4731-ab12-c9aea74bd1fa tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:52.868356 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d476bca5-2759-4731-ab12-c9aea74bd1fa tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1464 microversion: 2.1 time: 0.642833 Apr 11 13:57:52.871954 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 133/263] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:52 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1464 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:52.887269 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e5c5eafa-2cd9-4b0f-a02b-883153898034 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:52.887921 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e5c5eafa-2cd9-4b0f-a02b-883153898034 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:52.925080 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e5c5eafa-2cd9-4b0f-a02b-883153898034 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:52.925544 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e5c5eafa-2cd9-4b0f-a02b-883153898034 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:52.926342 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e5c5eafa-2cd9-4b0f-a02b-883153898034 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:52.930615 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e5c5eafa-2cd9-4b0f-a02b-883153898034 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:52.962967 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9f55140f-db3f-4039-bb62-5c9cf07293fc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:52.978135 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9f55140f-db3f-4039-bb62-5c9cf07293fc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:52.980704 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9f55140f-db3f-4039-bb62-5c9cf07293fc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:52.990641 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9f55140f-db3f-4039-bb62-5c9cf07293fc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.396916 Apr 11 13:57:52.992414 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 131/264] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:52 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:53.009739 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-67f8101b-7ec9-4b1e-bcac-8bfb058c79b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:53.010814 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-67f8101b-7ec9-4b1e-bcac-8bfb058c79b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:53.036435 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-67f8101b-7ec9-4b1e-bcac-8bfb058c79b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:53.036884 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-67f8101b-7ec9-4b1e-bcac-8bfb058c79b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:53.037678 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-67f8101b-7ec9-4b1e-bcac-8bfb058c79b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:53.038110 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-67f8101b-7ec9-4b1e-bcac-8bfb058c79b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:53.129017 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-67f8101b-7ec9-4b1e-bcac-8bfb058c79b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 13:57:53.391775 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-67f8101b-7ec9-4b1e-bcac-8bfb058c79b3 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 204 len: 0 microversion: 2.1 time: 0.396524 Apr 11 13:57:53.399283 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 132/265] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 13:57:52 2022] DELETE /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 13:57:53.415376 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e5e54710-9d8a-4b64-95c2-c7befc1d2bc1 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:53.416807 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e5e54710-9d8a-4b64-95c2-c7befc1d2bc1 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:53.431544 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e5e54710-9d8a-4b64-95c2-c7befc1d2bc1 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:53.436195 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e5e54710-9d8a-4b64-95c2-c7befc1d2bc1 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:53.442279 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e5e54710-9d8a-4b64-95c2-c7befc1d2bc1 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:53.442923 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e5e54710-9d8a-4b64-95c2-c7befc1d2bc1 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:53.592169 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e5c5eafa-2cd9-4b0f-a02b-883153898034 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:53.600442 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e5c5eafa-2cd9-4b0f-a02b-883153898034 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1369 microversion: 2.1 time: 0.727176 Apr 11 13:57:53.601034 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 134/266] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:52 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1369 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:53.763153 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e5e54710-9d8a-4b64-95c2-c7befc1d2bc1 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:53.771872 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e5e54710-9d8a-4b64-95c2-c7befc1d2bc1 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1470 microversion: 2.1 time: 0.370390 Apr 11 13:57:53.777172 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 133/267] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:53 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1470 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:54.012057 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-665b969b-79be-4ee8-a736-600fc0263d67 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:54.012675 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-665b969b-79be-4ee8-a736-600fc0263d67 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:54.021916 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-665b969b-79be-4ee8-a736-600fc0263d67 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:54.022371 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-665b969b-79be-4ee8-a736-600fc0263d67 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:54.030177 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-665b969b-79be-4ee8-a736-600fc0263d67 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:54.032479 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-665b969b-79be-4ee8-a736-600fc0263d67 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:54.495623 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-665b969b-79be-4ee8-a736-600fc0263d67 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:54.503987 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-665b969b-79be-4ee8-a736-600fc0263d67 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:54.505491 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-665b969b-79be-4ee8-a736-600fc0263d67 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:54.506674 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-665b969b-79be-4ee8-a736-600fc0263d67 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.499359 Apr 11 13:57:54.509255 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 135/268] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:54 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:54.621009 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-813e4268-54ec-4c55-ba5a-b5ea50967c25 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:54.621779 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-813e4268-54ec-4c55-ba5a-b5ea50967c25 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:54.633190 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-813e4268-54ec-4c55-ba5a-b5ea50967c25 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:54.633972 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-813e4268-54ec-4c55-ba5a-b5ea50967c25 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:54.634859 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-813e4268-54ec-4c55-ba5a-b5ea50967c25 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:54.638919 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-813e4268-54ec-4c55-ba5a-b5ea50967c25 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:54.795741 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3850f6e8-5369-40ef-9b4e-1c1b8b51dc63 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:54.796378 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3850f6e8-5369-40ef-9b4e-1c1b8b51dc63 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:54.805496 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3850f6e8-5369-40ef-9b4e-1c1b8b51dc63 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:54.808159 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3850f6e8-5369-40ef-9b4e-1c1b8b51dc63 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:54.810107 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3850f6e8-5369-40ef-9b4e-1c1b8b51dc63 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:54.810836 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3850f6e8-5369-40ef-9b4e-1c1b8b51dc63 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:55.351833 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-3850f6e8-5369-40ef-9b4e-1c1b8b51dc63 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:55.361102 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3850f6e8-5369-40ef-9b4e-1c1b8b51dc63 tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1470 microversion: 2.1 time: 0.571358 Apr 11 13:57:55.377971 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 136/269] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:54 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1470 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:55.499502 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-813e4268-54ec-4c55-ba5a-b5ea50967c25 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:55.509885 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-813e4268-54ec-4c55-ba5a-b5ea50967c25 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1369 microversion: 2.1 time: 0.893121 Apr 11 13:57:55.518003 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 134/270] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:54 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1369 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:55.538456 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9323b43f-be6a-4bc9-95f1-0ac36a03a95b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:55.542345 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9323b43f-be6a-4bc9-95f1-0ac36a03a95b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:55.560040 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9323b43f-be6a-4bc9-95f1-0ac36a03a95b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:55.560705 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9323b43f-be6a-4bc9-95f1-0ac36a03a95b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:55.561722 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9323b43f-be6a-4bc9-95f1-0ac36a03a95b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:55.564853 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9323b43f-be6a-4bc9-95f1-0ac36a03a95b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:56.034417 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9323b43f-be6a-4bc9-95f1-0ac36a03a95b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:56.045418 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9323b43f-be6a-4bc9-95f1-0ac36a03a95b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:56.051946 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9323b43f-be6a-4bc9-95f1-0ac36a03a95b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:56.055494 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9323b43f-be6a-4bc9-95f1-0ac36a03a95b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.527191 Apr 11 13:57:56.058852 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 137/271] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:55 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:57:56.396510 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7942e02a-2767-4c78-ba43-b806a2a5431d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:56.397323 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7942e02a-2767-4c78-ba43-b806a2a5431d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:56.425905 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7942e02a-2767-4c78-ba43-b806a2a5431d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:56.427581 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7942e02a-2767-4c78-ba43-b806a2a5431d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:56.428566 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7942e02a-2767-4c78-ba43-b806a2a5431d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:56.429094 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7942e02a-2767-4c78-ba43-b806a2a5431d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:56.537830 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0a38eba6-8b16-42ef-8fcb-a1f1df8dcddc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:56.539323 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0a38eba6-8b16-42ef-8fcb-a1f1df8dcddc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:56.555983 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0a38eba6-8b16-42ef-8fcb-a1f1df8dcddc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:56.557126 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0a38eba6-8b16-42ef-8fcb-a1f1df8dcddc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:56.559857 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0a38eba6-8b16-42ef-8fcb-a1f1df8dcddc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:56.560482 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0a38eba6-8b16-42ef-8fcb-a1f1df8dcddc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:56.621898 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7942e02a-2767-4c78-ba43-b806a2a5431d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73000e2a51b8452e9e25ecde059ce0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b883dc95a4349fba7f113cbe48b4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:56.650332 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7942e02a-2767-4c78-ba43-b806a2a5431d tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 200 len: 1428 microversion: 2.1 time: 0.258970 Apr 11 13:57:56.670148 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 135/272] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:56 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 1428 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:57:56.732426 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-dc5a39aa-bf6e-4df0-8d76-ce4c8ceea79f req-ee58c8ad-fe0f-49cd-9ce9-eab3fd268161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc267f34-a781-49f9-8046-13bb95dfd815", "name": "network-vif-deleted", "tag": "66864fa9-4e22-4107-8f15-e9d9fa5c63ec"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:57:56.769323 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-dc5a39aa-bf6e-4df0-8d76-ce4c8ceea79f req-ee58c8ad-fe0f-49cd-9ce9-eab3fd268161 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:56.775592 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-dc5a39aa-bf6e-4df0-8d76-ce4c8ceea79f req-ee58c8ad-fe0f-49cd-9ce9-eab3fd268161 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:56.807547 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-dc5a39aa-bf6e-4df0-8d76-ce4c8ceea79f req-ee58c8ad-fe0f-49cd-9ce9-eab3fd268161 service nova] Creating event network-vif-deleted:66864fa9-4e22-4107-8f15-e9d9fa5c63ec for instance bc267f34-a781-49f9-8046-13bb95dfd815 on hv-cinder-83078 Apr 11 13:57:56.828167 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-dc5a39aa-bf6e-4df0-8d76-ce4c8ceea79f req-ee58c8ad-fe0f-49cd-9ce9-eab3fd268161 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100833 Apr 11 13:57:56.834857 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 136/273] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 13:57:57.079216 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3156dd29-d236-480b-aa17-33bfd85bcb1a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:57.081275 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3156dd29-d236-480b-aa17-33bfd85bcb1a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:57.114887 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3156dd29-d236-480b-aa17-33bfd85bcb1a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:57.115909 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3156dd29-d236-480b-aa17-33bfd85bcb1a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:57.122793 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3156dd29-d236-480b-aa17-33bfd85bcb1a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:57.124901 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3156dd29-d236-480b-aa17-33bfd85bcb1a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:57.499055 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3156dd29-d236-480b-aa17-33bfd85bcb1a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:57.507144 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3156dd29-d236-480b-aa17-33bfd85bcb1a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:57.508706 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3156dd29-d236-480b-aa17-33bfd85bcb1a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:57.509885 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3156dd29-d236-480b-aa17-33bfd85bcb1a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.436635 Apr 11 13:57:57.510448 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 137/274] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:57 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:57:57.609632 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0a38eba6-8b16-42ef-8fcb-a1f1df8dcddc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:57.619685 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0a38eba6-8b16-42ef-8fcb-a1f1df8dcddc tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1369 microversion: 2.1 time: 1.088816 Apr 11 13:57:57.625788 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 138/275] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:56 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1369 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:57.686501 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3c76150e-8fa5-4fb4-bb9e-a506b7dc4fca tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:57.687384 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3c76150e-8fa5-4fb4-bb9e-a506b7dc4fca tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] [instance: bc267f34-a781-49f9-8046-13bb95dfd815] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:57.698748 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c76150e-8fa5-4fb4-bb9e-a506b7dc4fca tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:57.699515 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c76150e-8fa5-4fb4-bb9e-a506b7dc4fca tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:57.701240 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c76150e-8fa5-4fb4-bb9e-a506b7dc4fca tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:57.702367 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c76150e-8fa5-4fb4-bb9e-a506b7dc4fca tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:57.739144 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-3c76150e-8fa5-4fb4-bb9e-a506b7dc4fca tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] HTTP exception thrown: Instance bc267f34-a781-49f9-8046-13bb95dfd815 could not be found. Apr 11 13:57:57.743971 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3c76150e-8fa5-4fb4-bb9e-a506b7dc4fca tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] Returning 404 to user: Instance bc267f34-a781-49f9-8046-13bb95dfd815 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:57:57.745157 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3c76150e-8fa5-4fb4-bb9e-a506b7dc4fca tempest-VolumesNegativeTest-1305465451 tempest-VolumesNegativeTest-1305465451-project] 10.222.0.67 "GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815" status: 404 len: 111 microversion: 2.1 time: 0.062727 Apr 11 13:57:57.745882 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 138/276] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:57 2022] GET /compute/v2.1/servers/bc267f34-a781-49f9-8046-13bb95dfd815 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 13:57:58.528347 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2bfc9dbd-e732-43ca-8eb8-a389e75e6afb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:58.528963 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2bfc9dbd-e732-43ca-8eb8-a389e75e6afb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:58.541498 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2bfc9dbd-e732-43ca-8eb8-a389e75e6afb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:58.542196 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2bfc9dbd-e732-43ca-8eb8-a389e75e6afb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:58.542980 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2bfc9dbd-e732-43ca-8eb8-a389e75e6afb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:58.543415 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2bfc9dbd-e732-43ca-8eb8-a389e75e6afb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:58.636949 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e103e3bb-c3d7-4f78-b500-dd8688967d8b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:57:58.637553 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e103e3bb-c3d7-4f78-b500-dd8688967d8b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:57:58.646075 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e103e3bb-c3d7-4f78-b500-dd8688967d8b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:58.651112 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e103e3bb-c3d7-4f78-b500-dd8688967d8b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:58.652138 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e103e3bb-c3d7-4f78-b500-dd8688967d8b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:57:58.652586 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e103e3bb-c3d7-4f78-b500-dd8688967d8b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:57:59.045963 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2bfc9dbd-e732-43ca-8eb8-a389e75e6afb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:59.049375 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e103e3bb-c3d7-4f78-b500-dd8688967d8b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:59.057071 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e103e3bb-c3d7-4f78-b500-dd8688967d8b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1369 microversion: 2.1 time: 0.423876 Apr 11 13:57:59.057665 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 139/277] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:57:58 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1369 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:57:59.090268 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2bfc9dbd-e732-43ca-8eb8-a389e75e6afb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:59.107494 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2bfc9dbd-e732-43ca-8eb8-a389e75e6afb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:57:59.112956 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2bfc9dbd-e732-43ca-8eb8-a389e75e6afb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.588487 Apr 11 13:57:59.134314 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 139/278] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:57:58 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:00.074389 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8979537c-afad-47d3-9c51-761f98b9ef84 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:00.075146 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8979537c-afad-47d3-9c51-761f98b9ef84 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:00.087412 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8979537c-afad-47d3-9c51-761f98b9ef84 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:00.087912 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8979537c-afad-47d3-9c51-761f98b9ef84 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:00.088704 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8979537c-afad-47d3-9c51-761f98b9ef84 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:00.096371 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8979537c-afad-47d3-9c51-761f98b9ef84 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:00.138182 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ed2c4320-0127-4918-82f1-179299d37817 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:00.138835 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ed2c4320-0127-4918-82f1-179299d37817 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:00.160297 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ed2c4320-0127-4918-82f1-179299d37817 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:00.165576 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ed2c4320-0127-4918-82f1-179299d37817 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:00.168956 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ed2c4320-0127-4918-82f1-179299d37817 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:00.169655 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ed2c4320-0127-4918-82f1-179299d37817 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:00.499963 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8979537c-afad-47d3-9c51-761f98b9ef84 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:00.508114 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8979537c-afad-47d3-9c51-761f98b9ef84 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1369 microversion: 2.1 time: 0.437610 Apr 11 13:58:00.524040 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 140/279] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:00 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1369 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:00.851152 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ed2c4320-0127-4918-82f1-179299d37817 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:00.866034 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ed2c4320-0127-4918-82f1-179299d37817 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:00.875353 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ed2c4320-0127-4918-82f1-179299d37817 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:00.877235 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ed2c4320-0127-4918-82f1-179299d37817 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.743742 Apr 11 13:58:00.877912 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 140/280] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:00 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:58:01.525490 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9fe0577c-401b-43e8-b092-ae0962853b4b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:01.526113 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9fe0577c-401b-43e8-b092-ae0962853b4b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:01.535814 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9fe0577c-401b-43e8-b092-ae0962853b4b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:01.536274 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9fe0577c-401b-43e8-b092-ae0962853b4b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:01.537068 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9fe0577c-401b-43e8-b092-ae0962853b4b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:01.537509 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9fe0577c-401b-43e8-b092-ae0962853b4b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:01.899700 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e8b1a706-4d3b-4360-9edf-37d189d80ea1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:01.900316 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e8b1a706-4d3b-4360-9edf-37d189d80ea1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:01.920964 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e8b1a706-4d3b-4360-9edf-37d189d80ea1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:01.921826 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e8b1a706-4d3b-4360-9edf-37d189d80ea1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:01.933595 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e8b1a706-4d3b-4360-9edf-37d189d80ea1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:01.934313 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e8b1a706-4d3b-4360-9edf-37d189d80ea1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:01.983688 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9fe0577c-401b-43e8-b092-ae0962853b4b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:01.994815 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9fe0577c-401b-43e8-b092-ae0962853b4b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1369 microversion: 2.1 time: 0.473248 Apr 11 13:58:02.003220 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 141/281] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:01 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1369 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:02.188443 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b8219da5-4b5d-49fe-909f-275a2672e4b3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:02.190160 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b8219da5-4b5d-49fe-909f-275a2672e4b3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:02.197307 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b8219da5-4b5d-49fe-909f-275a2672e4b3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:02.206917 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b8219da5-4b5d-49fe-909f-275a2672e4b3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:02.216144 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b8219da5-4b5d-49fe-909f-275a2672e4b3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:02.216860 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b8219da5-4b5d-49fe-909f-275a2672e4b3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:02.300419 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b8219da5-4b5d-49fe-909f-275a2672e4b3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/ips" status: 200 len: 146 microversion: 2.1 time: 0.115688 Apr 11 13:58:02.308304 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 142/282] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Apr 11 13:58:02 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/ips => generated 146 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:58:02.912457 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e8b1a706-4d3b-4360-9edf-37d189d80ea1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:02.929251 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e8b1a706-4d3b-4360-9edf-37d189d80ea1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:02.932360 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e8b1a706-4d3b-4360-9edf-37d189d80ea1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:02.935560 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e8b1a706-4d3b-4360-9edf-37d189d80ea1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 1.039685 Apr 11 13:58:02.940302 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 141/283] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:01 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:03.031223 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-712fbb33-cbaf-4fc7-b879-4f7098e07ff4 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:03.031886 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-712fbb33-cbaf-4fc7-b879-4f7098e07ff4 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:03.050593 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-712fbb33-cbaf-4fc7-b879-4f7098e07ff4 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:03.051447 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-712fbb33-cbaf-4fc7-b879-4f7098e07ff4 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:03.052496 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-712fbb33-cbaf-4fc7-b879-4f7098e07ff4 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:03.053720 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-712fbb33-cbaf-4fc7-b879-4f7098e07ff4 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:03.464076 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-712fbb33-cbaf-4fc7-b879-4f7098e07ff4 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:03.481590 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-712fbb33-cbaf-4fc7-b879-4f7098e07ff4 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1369 microversion: 2.1 time: 0.454075 Apr 11 13:58:03.486260 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 143/284] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:03 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1369 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:03.893021 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-7358f446-70f0-49c9-856f-dda56a579aaa req-054136c1-5ad1-4400-8f3e-f955a8ca63c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b122bc-5193-4642-9f21-0e30c573c88e", "name": "network-vif-plugged", "status": "completed", "tag": "dd31c02f-d45d-4905-89c8-0c0d76d81cb0"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:03.910475 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-7358f446-70f0-49c9-856f-dda56a579aaa req-054136c1-5ad1-4400-8f3e-f955a8ca63c2 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:03.917369 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-7358f446-70f0-49c9-856f-dda56a579aaa req-054136c1-5ad1-4400-8f3e-f955a8ca63c2 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:03.948157 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-7358f446-70f0-49c9-856f-dda56a579aaa req-054136c1-5ad1-4400-8f3e-f955a8ca63c2 service nova] Creating event network-vif-plugged:dd31c02f-d45d-4905-89c8-0c0d76d81cb0 for instance a1b122bc-5193-4642-9f21-0e30c573c88e on hv-cinder-83078 Apr 11 13:58:03.955418 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d0a72feb-10fa-4937-9df5-07fc48fcb86a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:03.956218 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d0a72feb-10fa-4937-9df5-07fc48fcb86a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:03.963170 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d0a72feb-10fa-4937-9df5-07fc48fcb86a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:03.963653 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d0a72feb-10fa-4937-9df5-07fc48fcb86a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:03.964428 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d0a72feb-10fa-4937-9df5-07fc48fcb86a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:03.964872 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d0a72feb-10fa-4937-9df5-07fc48fcb86a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:03.978977 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-7358f446-70f0-49c9-856f-dda56a579aaa req-054136c1-5ad1-4400-8f3e-f955a8ca63c2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089442 Apr 11 13:58:03.982089 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 142/285] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:58:04.353400 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d0a72feb-10fa-4937-9df5-07fc48fcb86a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:04.363098 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d0a72feb-10fa-4937-9df5-07fc48fcb86a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:04.401178 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d0a72feb-10fa-4937-9df5-07fc48fcb86a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:04.402443 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d0a72feb-10fa-4937-9df5-07fc48fcb86a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.451560 Apr 11 13:58:04.403013 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 144/286] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:03 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:58:04.502127 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-50b8cd5b-6492-4179-a99b-9ec705d6c603 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:04.503608 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-50b8cd5b-6492-4179-a99b-9ec705d6c603 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:04.518633 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-50b8cd5b-6492-4179-a99b-9ec705d6c603 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:04.519507 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-50b8cd5b-6492-4179-a99b-9ec705d6c603 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:04.521810 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-50b8cd5b-6492-4179-a99b-9ec705d6c603 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:04.522432 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-50b8cd5b-6492-4179-a99b-9ec705d6c603 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:04.960198 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-50b8cd5b-6492-4179-a99b-9ec705d6c603 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:04.973705 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-50b8cd5b-6492-4179-a99b-9ec705d6c603 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1369 microversion: 2.1 time: 0.476762 Apr 11 13:58:04.974569 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 143/287] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:04 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1369 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:05.421032 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f04bb73f-097a-457e-861a-44286f1fd096 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:05.421767 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f04bb73f-097a-457e-861a-44286f1fd096 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:05.439514 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f04bb73f-097a-457e-861a-44286f1fd096 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:05.440136 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f04bb73f-097a-457e-861a-44286f1fd096 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:05.443139 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f04bb73f-097a-457e-861a-44286f1fd096 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:05.444120 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f04bb73f-097a-457e-861a-44286f1fd096 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:05.452265 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-194c2c58-a927-413f-90ad-0c1698e7d64e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68f53176-b8e7-41ea-b2f3-abe907a54b9d"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:05.454546 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-194c2c58-a927-413f-90ad-0c1698e7d64e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:05.470755 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-194c2c58-a927-413f-90ad-0c1698e7d64e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:05.472759 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-194c2c58-a927-413f-90ad-0c1698e7d64e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:05.473868 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-194c2c58-a927-413f-90ad-0c1698e7d64e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:05.475163 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-194c2c58-a927-413f-90ad-0c1698e7d64e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:05.834671 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f04bb73f-097a-457e-861a-44286f1fd096 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:05.849495 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f04bb73f-097a-457e-861a-44286f1fd096 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:05.857655 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f04bb73f-097a-457e-861a-44286f1fd096 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:05.861702 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f04bb73f-097a-457e-861a-44286f1fd096 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.444572 Apr 11 13:58:05.862296 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 145/288] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:05 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:05.995781 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f4d2eb9d-65d6-4c89-a434-80bf90fba5ca tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:05.996579 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f4d2eb9d-65d6-4c89-a434-80bf90fba5ca tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:06.008764 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f4d2eb9d-65d6-4c89-a434-80bf90fba5ca tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:06.012334 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f4d2eb9d-65d6-4c89-a434-80bf90fba5ca tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:06.013414 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f4d2eb9d-65d6-4c89-a434-80bf90fba5ca tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:06.014055 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f4d2eb9d-65d6-4c89-a434-80bf90fba5ca tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:06.433597 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f4d2eb9d-65d6-4c89-a434-80bf90fba5ca tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:06.445764 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f4d2eb9d-65d6-4c89-a434-80bf90fba5ca tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1369 microversion: 2.1 time: 0.452435 Apr 11 13:58:06.449710 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 146/289] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:05 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1369 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:06.586920 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-194c2c58-a927-413f-90ad-0c1698e7d64e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "POST /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.138657 Apr 11 13:58:06.600236 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 144/290] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 13:58:05 2022] POST /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/os-volume_attachments => generated 194 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 13:58:06.897031 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7932b20b-c3aa-4bba-8515-fef794b21007 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:06.898137 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7932b20b-c3aa-4bba-8515-fef794b21007 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:06.916102 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7932b20b-c3aa-4bba-8515-fef794b21007 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:06.917057 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7932b20b-c3aa-4bba-8515-fef794b21007 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:06.918003 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7932b20b-c3aa-4bba-8515-fef794b21007 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:06.918595 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7932b20b-c3aa-4bba-8515-fef794b21007 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:07.294236 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7932b20b-c3aa-4bba-8515-fef794b21007 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:07.321102 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7932b20b-c3aa-4bba-8515-fef794b21007 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:07.326201 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7932b20b-c3aa-4bba-8515-fef794b21007 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:07.327731 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7932b20b-c3aa-4bba-8515-fef794b21007 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.449352 Apr 11 13:58:07.338448 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 147/291] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:06 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:07.468162 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a2dad5d6-3da8-4ab7-a778-39bc5073acc0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:07.470121 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a2dad5d6-3da8-4ab7-a778-39bc5073acc0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:07.499708 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a2dad5d6-3da8-4ab7-a778-39bc5073acc0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:07.500170 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a2dad5d6-3da8-4ab7-a778-39bc5073acc0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:07.501017 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a2dad5d6-3da8-4ab7-a778-39bc5073acc0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:07.501604 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a2dad5d6-3da8-4ab7-a778-39bc5073acc0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:07.879497 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a2dad5d6-3da8-4ab7-a778-39bc5073acc0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:07.902286 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a2dad5d6-3da8-4ab7-a778-39bc5073acc0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1563 microversion: 2.1 time: 0.439670 Apr 11 13:58:07.903387 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 145/292] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:07 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1563 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:07.926613 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-db02fc28-1556-49e2-b03a-6f6b92a29240 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:07.927764 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-db02fc28-1556-49e2-b03a-6f6b92a29240 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:07.937079 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db02fc28-1556-49e2-b03a-6f6b92a29240 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:07.940684 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db02fc28-1556-49e2-b03a-6f6b92a29240 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:07.943159 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db02fc28-1556-49e2-b03a-6f6b92a29240 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:07.944245 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db02fc28-1556-49e2-b03a-6f6b92a29240 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:08.085572 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-db02fc28-1556-49e2-b03a-6f6b92a29240 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164497 Apr 11 13:58:08.086860 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 148/293] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Apr 11 13:58:07 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:58:08.350596 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4e33c9a9-1870-48b1-a24e-11fd0e4d09d2 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:08.351213 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4e33c9a9-1870-48b1-a24e-11fd0e4d09d2 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:08.361343 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4e33c9a9-1870-48b1-a24e-11fd0e4d09d2 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:08.364245 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4e33c9a9-1870-48b1-a24e-11fd0e4d09d2 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:08.365208 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4e33c9a9-1870-48b1-a24e-11fd0e4d09d2 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:08.369820 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4e33c9a9-1870-48b1-a24e-11fd0e4d09d2 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:08.996817 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4e33c9a9-1870-48b1-a24e-11fd0e4d09d2 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:09.008967 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4e33c9a9-1870-48b1-a24e-11fd0e4d09d2 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:09.023083 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4e33c9a9-1870-48b1-a24e-11fd0e4d09d2 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:09.032865 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4e33c9a9-1870-48b1-a24e-11fd0e4d09d2 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.677819 Apr 11 13:58:09.033711 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 146/294] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:08 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:10.059020 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9fc92873-026e-4303-9119-35da5925018e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:10.064479 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9fc92873-026e-4303-9119-35da5925018e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:10.081339 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9fc92873-026e-4303-9119-35da5925018e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:10.082060 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9fc92873-026e-4303-9119-35da5925018e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:10.083122 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9fc92873-026e-4303-9119-35da5925018e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:10.083798 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9fc92873-026e-4303-9119-35da5925018e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:10.865139 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9fc92873-026e-4303-9119-35da5925018e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:10.873833 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9fc92873-026e-4303-9119-35da5925018e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:10.885329 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9fc92873-026e-4303-9119-35da5925018e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:10.886925 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9fc92873-026e-4303-9119-35da5925018e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.836231 Apr 11 13:58:10.888041 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 149/295] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:10 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:11.329467 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ddc88db1-94de-41ed-af8d-e81b69c919e0 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Action: 'create', calling method: .version_select at 0x7f73073a38b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1803271748"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:11.378158 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-ddc88db1-94de-41ed-af8d-e81b69c919e0 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Getting quotas for project 644547f80e2543079781f0c7b34c40b4. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:58:11.403235 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-ddc88db1-94de-41ed-af8d-e81b69c919e0 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Getting quotas for user b3d95fb42f294675a9e9bb5f03304390 and project 644547f80e2543079781f0c7b34c40b4. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:58:11.406641 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-5a127b32-a549-4c7c-8e3b-03faa2b437f4 req-4dca0536-a8bd-4252-9774-f7803e38bc3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b122bc-5193-4642-9f21-0e30c573c88e", "tag": "dd31c02f-d45d-4905-89c8-0c0d76d81cb0"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:11.424798 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-5a127b32-a549-4c7c-8e3b-03faa2b437f4 req-4dca0536-a8bd-4252-9774-f7803e38bc3a service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:11.449857 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-5a127b32-a549-4c7c-8e3b-03faa2b437f4 req-4dca0536-a8bd-4252-9774-f7803e38bc3a service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:11.504317 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-5a127b32-a549-4c7c-8e3b-03faa2b437f4 req-4dca0536-a8bd-4252-9774-f7803e38bc3a service nova] Creating event network-changed:dd31c02f-d45d-4905-89c8-0c0d76d81cb0 for instance a1b122bc-5193-4642-9f21-0e30c573c88e on hv-cinder-83078 Apr 11 13:58:11.513948 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-5a127b32-a549-4c7c-8e3b-03faa2b437f4 req-4dca0536-a8bd-4252-9774-f7803e38bc3a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110689 Apr 11 13:58:11.515721 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 150/296] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:58:11.906384 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-548edafc-5cc9-4d22-9936-d5908c79791a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:11.908180 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-548edafc-5cc9-4d22-9936-d5908c79791a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:11.925589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-548edafc-5cc9-4d22-9936-d5908c79791a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:11.926328 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-548edafc-5cc9-4d22-9936-d5908c79791a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:11.929768 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-548edafc-5cc9-4d22-9936-d5908c79791a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:11.930441 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-548edafc-5cc9-4d22-9936-d5908c79791a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:11.944862 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-ddc88db1-94de-41ed-af8d-e81b69c919e0 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Getting quotas for project 644547f80e2543079781f0c7b34c40b4. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:58:11.953032 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-ddc88db1-94de-41ed-af8d-e81b69c919e0 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Getting quotas for user b3d95fb42f294675a9e9bb5f03304390 and project 644547f80e2543079781f0c7b34c40b4. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:58:11.980564 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ddc88db1-94de-41ed-af8d-e81b69c919e0 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.655221 Apr 11 13:58:11.991965 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 147/297] 10.222.0.67 () {60 vars in 1157 bytes} [Mon Apr 11 13:58:11 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:12.231997 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-548edafc-5cc9-4d22-9936-d5908c79791a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:12.249509 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-548edafc-5cc9-4d22-9936-d5908c79791a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:12.253064 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-548edafc-5cc9-4d22-9936-d5908c79791a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:12.254778 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-548edafc-5cc9-4d22-9936-d5908c79791a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.352601 Apr 11 13:58:12.256591 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 151/298] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:11 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:58:12.290306 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1830762475", "imageRef": "837713bb-610d-4656-947c-0799e44d3562", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1803271748", "networks": [{"uuid": "a26678c1-118d-435e-989f-6f50cac836e0"}]}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:12.540204 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] validate_networks() for [('a26678c1-118d-435e-989f-6f50cac836e0', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 13:58:13.273137 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-24fc43ad-5ed4-4b92-9595-e5791687b104 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:13.274043 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-24fc43ad-5ed4-4b92-9595-e5791687b104 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:13.284431 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24fc43ad-5ed4-4b92-9595-e5791687b104 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:13.286717 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24fc43ad-5ed4-4b92-9595-e5791687b104 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:13.289106 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24fc43ad-5ed4-4b92-9595-e5791687b104 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:13.300010 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24fc43ad-5ed4-4b92-9595-e5791687b104 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:13.618517 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-24fc43ad-5ed4-4b92-9595-e5791687b104 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:13.632700 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-24fc43ad-5ed4-4b92-9595-e5791687b104 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:13.634223 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-24fc43ad-5ed4-4b92-9595-e5791687b104 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:13.636006 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-24fc43ad-5ed4-4b92-9595-e5791687b104 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1739 microversion: 2.20 time: 0.366179 Apr 11 13:58:13.637097 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 152/299] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:13 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1739 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:13.682269 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-26786700-ec77-4afc-b0e2-d5c253e7ea61 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:13.693590 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26786700-ec77-4afc-b0e2-d5c253e7ea61 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:13.694054 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26786700-ec77-4afc-b0e2-d5c253e7ea61 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:13.844233 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-26786700-ec77-4afc-b0e2-d5c253e7ea61 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Going to try to stop instance {{(pid=116941) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 11 13:58:13.961519 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-26786700-ec77-4afc-b0e2-d5c253e7ea61 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "POST /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/action" status: 202 len: 0 microversion: 2.1 time: 0.284949 Apr 11 13:58:13.965364 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 153/300] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 13:58:13 2022] POST /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 13:58:13.970695 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cef39f82-59fa-4994-a43d-9f311ce348c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:13.971405 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cef39f82-59fa-4994-a43d-9f311ce348c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:13.991461 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cef39f82-59fa-4994-a43d-9f311ce348c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:13.991944 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cef39f82-59fa-4994-a43d-9f311ce348c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:13.992742 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cef39f82-59fa-4994-a43d-9f311ce348c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:13.993182 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cef39f82-59fa-4994-a43d-9f311ce348c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:14.316939 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cef39f82-59fa-4994-a43d-9f311ce348c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:14.330394 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cef39f82-59fa-4994-a43d-9f311ce348c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.363716 Apr 11 13:58:14.331246 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 154/301] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:13 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:14.540094 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 13:58:14.540549 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 13:58:14.541236 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 13:58:14.541655 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 13:58:14.542068 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 13:58:14.552054 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:14.552511 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:14.553347 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:14.553785 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:14.576700 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Getting quotas for project 644547f80e2543079781f0c7b34c40b4. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:58:14.584637 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Getting quotas for user b3d95fb42f294675a9e9bb5f03304390 and project 644547f80e2543079781f0c7b34c40b4. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:58:14.597613 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 13:58:14.600077 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='837713bb-610d-4656-947c-0799e44d3562',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 13:58:14.655085 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ab990ad4-5821-4a90-8288-b8de23e2e13f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.368884 Apr 11 13:58:14.655234 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e9b81dcb-8ad1-460e-9b6f-ad0cb6f6a20a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:14.655821 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e9b81dcb-8ad1-460e-9b6f-ad0cb6f6a20a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:14.656785 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 148/302] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 13:58:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 13:58:14.669331 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f431aa8d-d149-48a4-bb88-840f1947728a tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:14.670693 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f431aa8d-d149-48a4-bb88-840f1947728a tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:14.673021 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e9b81dcb-8ad1-460e-9b6f-ad0cb6f6a20a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:14.673494 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e9b81dcb-8ad1-460e-9b6f-ad0cb6f6a20a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:14.675454 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e9b81dcb-8ad1-460e-9b6f-ad0cb6f6a20a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:14.675933 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e9b81dcb-8ad1-460e-9b6f-ad0cb6f6a20a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:14.855563 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e9b81dcb-8ad1-460e-9b6f-ad0cb6f6a20a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:14.865628 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e9b81dcb-8ad1-460e-9b6f-ad0cb6f6a20a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:14.868519 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e9b81dcb-8ad1-460e-9b6f-ad0cb6f6a20a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:14.869910 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e9b81dcb-8ad1-460e-9b6f-ad0cb6f6a20a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1721 microversion: 2.20 time: 0.218978 Apr 11 13:58:14.877274 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 155/303] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:14 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:14.901560 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f431aa8d-d149-48a4-bb88-840f1947728a tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:14.916059 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f431aa8d-d149-48a4-bb88-840f1947728a tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1259 microversion: 2.1 time: 0.252329 Apr 11 13:58:14.916937 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 149/304] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:14 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1259 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:15.353898 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-38c765d3-db07-4781-9638-227b73b28c2f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:15.354529 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-38c765d3-db07-4781-9638-227b73b28c2f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:15.373944 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38c765d3-db07-4781-9638-227b73b28c2f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:15.374405 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38c765d3-db07-4781-9638-227b73b28c2f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:15.379286 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38c765d3-db07-4781-9638-227b73b28c2f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:15.380131 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38c765d3-db07-4781-9638-227b73b28c2f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:15.658446 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-38c765d3-db07-4781-9638-227b73b28c2f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:15.667824 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-38c765d3-db07-4781-9638-227b73b28c2f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.322251 Apr 11 13:58:15.679209 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 156/305] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:15 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:15.890432 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0ad07781-332f-4ab9-9e5a-696f3e9e9f58 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:15.891901 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0ad07781-332f-4ab9-9e5a-696f3e9e9f58 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:15.905657 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ad07781-332f-4ab9-9e5a-696f3e9e9f58 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:15.925357 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ad07781-332f-4ab9-9e5a-696f3e9e9f58 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:15.926278 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ad07781-332f-4ab9-9e5a-696f3e9e9f58 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:15.928171 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ad07781-332f-4ab9-9e5a-696f3e9e9f58 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:15.934425 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f6a79ffe-6a72-4b0b-8930-53b7856d0efe tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:15.935493 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f6a79ffe-6a72-4b0b-8930-53b7856d0efe tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:15.945674 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f6a79ffe-6a72-4b0b-8930-53b7856d0efe tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:15.949068 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f6a79ffe-6a72-4b0b-8930-53b7856d0efe tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:15.955365 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f6a79ffe-6a72-4b0b-8930-53b7856d0efe tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:15.956166 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f6a79ffe-6a72-4b0b-8930-53b7856d0efe tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:16.126671 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f6a79ffe-6a72-4b0b-8930-53b7856d0efe tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:16.137601 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f6a79ffe-6a72-4b0b-8930-53b7856d0efe tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1311 microversion: 2.1 time: 0.207755 Apr 11 13:58:16.144529 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 157/306] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:15 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1311 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:16.198938 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0ad07781-332f-4ab9-9e5a-696f3e9e9f58 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:16.208950 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0ad07781-332f-4ab9-9e5a-696f3e9e9f58 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:16.211066 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0ad07781-332f-4ab9-9e5a-696f3e9e9f58 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:16.212609 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0ad07781-332f-4ab9-9e5a-696f3e9e9f58 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1721 microversion: 2.20 time: 0.326127 Apr 11 13:58:16.225563 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 150/307] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:15 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1721 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:16.684956 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b98a5dcb-caf4-465d-94c9-67032234e4c8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:16.685575 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b98a5dcb-caf4-465d-94c9-67032234e4c8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:16.691994 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b98a5dcb-caf4-465d-94c9-67032234e4c8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:16.692737 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b98a5dcb-caf4-465d-94c9-67032234e4c8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:16.693720 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b98a5dcb-caf4-465d-94c9-67032234e4c8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:16.694349 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b98a5dcb-caf4-465d-94c9-67032234e4c8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:16.952422 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b98a5dcb-caf4-465d-94c9-67032234e4c8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:16.963769 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b98a5dcb-caf4-465d-94c9-67032234e4c8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.282487 Apr 11 13:58:16.964520 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 158/308] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:16 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:17.165842 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0ccd3db7-19aa-4d70-9835-e551cc96449e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:17.168156 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0ccd3db7-19aa-4d70-9835-e551cc96449e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:17.176624 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ccd3db7-19aa-4d70-9835-e551cc96449e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:17.177211 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ccd3db7-19aa-4d70-9835-e551cc96449e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:17.178155 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ccd3db7-19aa-4d70-9835-e551cc96449e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:17.178652 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ccd3db7-19aa-4d70-9835-e551cc96449e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:17.238633 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-798f2253-b0c9-4b9f-a899-9a394c165a00 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:17.239262 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-798f2253-b0c9-4b9f-a899-9a394c165a00 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:17.246641 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-798f2253-b0c9-4b9f-a899-9a394c165a00 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:17.247132 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-798f2253-b0c9-4b9f-a899-9a394c165a00 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:17.248153 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-798f2253-b0c9-4b9f-a899-9a394c165a00 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:17.254253 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-798f2253-b0c9-4b9f-a899-9a394c165a00 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:17.262215 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0ccd3db7-19aa-4d70-9835-e551cc96449e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:17.273127 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0ccd3db7-19aa-4d70-9835-e551cc96449e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1319 microversion: 2.1 time: 0.113411 Apr 11 13:58:17.273728 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 151/309] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:17 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1319 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:17.513292 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-798f2253-b0c9-4b9f-a899-9a394c165a00 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:17.540915 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-798f2253-b0c9-4b9f-a899-9a394c165a00 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:17.545254 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-798f2253-b0c9-4b9f-a899-9a394c165a00 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:17.546891 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-798f2253-b0c9-4b9f-a899-9a394c165a00 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1721 microversion: 2.20 time: 0.312665 Apr 11 13:58:17.559251 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 159/310] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:17 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1721 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:58:17.982094 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0e2f64f6-c461-44d9-ad5d-06b6d591c64f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:17.982739 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0e2f64f6-c461-44d9-ad5d-06b6d591c64f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:17.994932 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e2f64f6-c461-44d9-ad5d-06b6d591c64f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:17.995389 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e2f64f6-c461-44d9-ad5d-06b6d591c64f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:17.996216 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e2f64f6-c461-44d9-ad5d-06b6d591c64f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:17.996745 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e2f64f6-c461-44d9-ad5d-06b6d591c64f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:18.294820 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5cfe90f9-7e79-49f7-bd26-f98d6e797bda tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:18.295244 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5cfe90f9-7e79-49f7-bd26-f98d6e797bda tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:18.309744 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5cfe90f9-7e79-49f7-bd26-f98d6e797bda tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:18.310194 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5cfe90f9-7e79-49f7-bd26-f98d6e797bda tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:18.310984 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5cfe90f9-7e79-49f7-bd26-f98d6e797bda tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:18.311422 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5cfe90f9-7e79-49f7-bd26-f98d6e797bda tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:18.359153 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0e2f64f6-c461-44d9-ad5d-06b6d591c64f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:18.373446 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0e2f64f6-c461-44d9-ad5d-06b6d591c64f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.392488 Apr 11 13:58:18.374427 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 152/311] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:17 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:18.566876 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b1be632b-45ae-4ac0-bb8f-2c441e42e724 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:18.568903 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b1be632b-45ae-4ac0-bb8f-2c441e42e724 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:18.572791 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5cfe90f9-7e79-49f7-bd26-f98d6e797bda tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:18.586600 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5cfe90f9-7e79-49f7-bd26-f98d6e797bda tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1317 microversion: 2.1 time: 0.299384 Apr 11 13:58:18.590023 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 160/312] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:18 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:18.597734 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1be632b-45ae-4ac0-bb8f-2c441e42e724 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:18.599954 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1be632b-45ae-4ac0-bb8f-2c441e42e724 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:18.601760 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1be632b-45ae-4ac0-bb8f-2c441e42e724 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:18.602441 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1be632b-45ae-4ac0-bb8f-2c441e42e724 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:18.616045 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-955735ef-abc8-47c3-b6f3-8266702f6cfb req-880457e6-0807-44ba-a58f-658a7971ea29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5f3b7d-8b92-4264-b41a-1d1ade879f2f", "name": "network-vif-unplugged", "status": "completed", "tag": "cda04f4a-80ef-4c18-b575-cb87293272ce"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:18.639288 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-955735ef-abc8-47c3-b6f3-8266702f6cfb req-880457e6-0807-44ba-a58f-658a7971ea29 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:18.641433 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-955735ef-abc8-47c3-b6f3-8266702f6cfb req-880457e6-0807-44ba-a58f-658a7971ea29 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:18.685589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.compute.server_external_events [req-955735ef-abc8-47c3-b6f3-8266702f6cfb req-880457e6-0807-44ba-a58f-658a7971ea29 service nova] Unable to find a host for instance 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f. Dropping event network-vif-unplugged {{(pid=116941) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 11 13:58:18.690088 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-955735ef-abc8-47c3-b6f3-8266702f6cfb req-880457e6-0807-44ba-a58f-658a7971ea29 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.078215 Apr 11 13:58:18.696751 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 161/313] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 86 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 11 13:58:18.991124 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b1be632b-45ae-4ac0-bb8f-2c441e42e724 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:18.999514 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b1be632b-45ae-4ac0-bb8f-2c441e42e724 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:19.009319 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b1be632b-45ae-4ac0-bb8f-2c441e42e724 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:19.010558 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b1be632b-45ae-4ac0-bb8f-2c441e42e724 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1664 microversion: 2.20 time: 0.448931 Apr 11 13:58:19.011133 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 153/314] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:18 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1664 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:19.038929 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bbc592b3-4890-4a22-b060-bb0d33acbbe6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "943b494a-1c30-483f-b707-5dc3ed3ffcf8"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:19.043587 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bbc592b3-4890-4a22-b060-bb0d33acbbe6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:19.065926 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbc592b3-4890-4a22-b060-bb0d33acbbe6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:19.066450 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbc592b3-4890-4a22-b060-bb0d33acbbe6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:19.069394 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbc592b3-4890-4a22-b060-bb0d33acbbe6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:19.069845 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbc592b3-4890-4a22-b060-bb0d33acbbe6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:19.779228 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d8b75871-7eab-401e-875f-e68a731f41db tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Action: 'create', calling method: .version_select at 0x7f7306b391f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1579021211"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:19.829046 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bbc592b3-4890-4a22-b060-bb0d33acbbe6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "POST /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.802007 Apr 11 13:58:19.833709 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 162/315] 10.222.0.67 () {62 vars in 1363 bytes} [Mon Apr 11 13:58:19 2022] POST /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-volume_attachments => generated 188 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:58:19.836217 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-d8b75871-7eab-401e-875f-e68a731f41db tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Getting quotas for project 626d5ba1efe34953a6d00b0f0afd5013. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:58:19.849947 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-d8b75871-7eab-401e-875f-e68a731f41db tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Getting quotas for user 4fd5089d5b5d4f71b5789cc10b7ff971 and project 626d5ba1efe34953a6d00b0f0afd5013. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:58:19.852920 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9666ae76-6a5e-4c11-bc83-10716782c66a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:19.856554 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9666ae76-6a5e-4c11-bc83-10716782c66a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:19.874296 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9666ae76-6a5e-4c11-bc83-10716782c66a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:19.875389 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9666ae76-6a5e-4c11-bc83-10716782c66a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:19.878640 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9666ae76-6a5e-4c11-bc83-10716782c66a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:19.889917 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9666ae76-6a5e-4c11-bc83-10716782c66a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:20.152922 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-d8b75871-7eab-401e-875f-e68a731f41db tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Getting quotas for project 626d5ba1efe34953a6d00b0f0afd5013. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:58:20.184252 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-d8b75871-7eab-401e-875f-e68a731f41db tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Getting quotas for user 4fd5089d5b5d4f71b5789cc10b7ff971 and project 626d5ba1efe34953a6d00b0f0afd5013. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:58:20.224143 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d8b75871-7eab-401e-875f-e68a731f41db tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 1.137415 Apr 11 13:58:20.224785 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 154/316] 10.222.0.67 () {60 vars in 1157 bytes} [Mon Apr 11 13:58:19 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:20.237350 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4ee10dde-23ee-4b5c-a7d4-bf9d62079262 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:20.238036 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4ee10dde-23ee-4b5c-a7d4-bf9d62079262 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:20.266426 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ee10dde-23ee-4b5c-a7d4-bf9d62079262 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:20.266943 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ee10dde-23ee-4b5c-a7d4-bf9d62079262 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:20.267795 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ee10dde-23ee-4b5c-a7d4-bf9d62079262 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:20.275013 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ee10dde-23ee-4b5c-a7d4-bf9d62079262 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:20.325857 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9666ae76-6a5e-4c11-bc83-10716782c66a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:20.339109 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9666ae76-6a5e-4c11-bc83-10716782c66a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.502498 Apr 11 13:58:20.342655 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 163/317] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:19 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:20.358769 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-766053b3-8ddd-43da-88b0-4c6c128815a3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:20.359791 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-766053b3-8ddd-43da-88b0-4c6c128815a3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:20.374589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-766053b3-8ddd-43da-88b0-4c6c128815a3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:20.375559 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-766053b3-8ddd-43da-88b0-4c6c128815a3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:20.376652 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-766053b3-8ddd-43da-88b0-4c6c128815a3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:20.378226 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-766053b3-8ddd-43da-88b0-4c6c128815a3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:20.617435 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4ee10dde-23ee-4b5c-a7d4-bf9d62079262 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:20.633877 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4ee10dde-23ee-4b5c-a7d4-bf9d62079262 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.403615 Apr 11 13:58:20.638509 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 155/318] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:20 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:20.655182 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-766053b3-8ddd-43da-88b0-4c6c128815a3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "POST /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/action" status: 202 len: 0 microversion: 2.20 time: 0.308896 Apr 11 13:58:20.656126 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 164/319] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Apr 11 13:58:20 2022] POST /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 13:58:20.672385 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-121e0025-13c7-4dae-a761-c401af17a456 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:20.673060 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-121e0025-13c7-4dae-a761-c401af17a456 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:20.691105 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-121e0025-13c7-4dae-a761-c401af17a456 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:20.703809 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-121e0025-13c7-4dae-a761-c401af17a456 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:20.707237 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-121e0025-13c7-4dae-a761-c401af17a456 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:20.709059 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-121e0025-13c7-4dae-a761-c401af17a456 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:21.005696 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-121e0025-13c7-4dae-a761-c401af17a456 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:21.020192 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-121e0025-13c7-4dae-a761-c401af17a456 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:21.022253 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-121e0025-13c7-4dae-a761-c401af17a456 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:21.027518 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-121e0025-13c7-4dae-a761-c401af17a456 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1750 microversion: 2.20 time: 0.367008 Apr 11 13:58:21.028652 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 156/320] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:20 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1750 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:21.154401 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-45c19447-8dba-4ec7-8ee9-100afaf59a35 req-52d8a8c5-5abe-40ac-a2b4-e5c87a23867c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79569212-4835-45da-92b0-516e527a1f88", "tag": "696c428a-2d32-4149-b9c4-40a4e382593e"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:21.194765 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-45c19447-8dba-4ec7-8ee9-100afaf59a35 req-52d8a8c5-5abe-40ac-a2b4-e5c87a23867c service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:21.195221 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-45c19447-8dba-4ec7-8ee9-100afaf59a35 req-52d8a8c5-5abe-40ac-a2b4-e5c87a23867c service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:21.223557 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-45c19447-8dba-4ec7-8ee9-100afaf59a35 req-52d8a8c5-5abe-40ac-a2b4-e5c87a23867c service nova] Creating event network-changed:696c428a-2d32-4149-b9c4-40a4e382593e for instance 79569212-4835-45da-92b0-516e527a1f88 on hv-cinder-83078 Apr 11 13:58:21.250151 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-45c19447-8dba-4ec7-8ee9-100afaf59a35 req-52d8a8c5-5abe-40ac-a2b4-e5c87a23867c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098743 Apr 11 13:58:21.253858 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 165/321] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:58:21.361109 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d4b87c6a-432c-43a5-bd5e-7f62a5a8e01f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:21.361717 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d4b87c6a-432c-43a5-bd5e-7f62a5a8e01f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:21.376806 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d4b87c6a-432c-43a5-bd5e-7f62a5a8e01f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:21.377264 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d4b87c6a-432c-43a5-bd5e-7f62a5a8e01f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:21.378052 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d4b87c6a-432c-43a5-bd5e-7f62a5a8e01f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:21.407252 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d4b87c6a-432c-43a5-bd5e-7f62a5a8e01f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:21.653640 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bcf1307d-e059-4812-816d-da25120ffd58 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:21.654607 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bcf1307d-e059-4812-816d-da25120ffd58 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:21.668214 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bcf1307d-e059-4812-816d-da25120ffd58 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:21.669418 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bcf1307d-e059-4812-816d-da25120ffd58 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:21.673524 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bcf1307d-e059-4812-816d-da25120ffd58 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:21.674386 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bcf1307d-e059-4812-816d-da25120ffd58 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:21.952336 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d4b87c6a-432c-43a5-bd5e-7f62a5a8e01f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:21.962507 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d4b87c6a-432c-43a5-bd5e-7f62a5a8e01f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.605917 Apr 11 13:58:21.967269 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 157/322] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:21 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:22.048760 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7abec635-eedd-4606-a99a-607be9a277c4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:22.050612 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7abec635-eedd-4606-a99a-607be9a277c4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:22.062584 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7abec635-eedd-4606-a99a-607be9a277c4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:22.063436 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7abec635-eedd-4606-a99a-607be9a277c4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:22.066041 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7abec635-eedd-4606-a99a-607be9a277c4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:22.068140 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7abec635-eedd-4606-a99a-607be9a277c4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:22.118071 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-bcf1307d-e059-4812-816d-da25120ffd58 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:22.132180 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bcf1307d-e059-4812-816d-da25120ffd58 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.481160 Apr 11 13:58:22.132794 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 166/323] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:21 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:22.533076 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7abec635-eedd-4606-a99a-607be9a277c4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:22.549014 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7abec635-eedd-4606-a99a-607be9a277c4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:22.564472 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7abec635-eedd-4606-a99a-607be9a277c4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:22.568670 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7abec635-eedd-4606-a99a-607be9a277c4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1750 microversion: 2.20 time: 0.525619 Apr 11 13:58:22.573503 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 158/324] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:22 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1750 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:58:22.985524 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f14d430c-e4ab-440b-bb06-900104e4a8b6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:22.986202 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f14d430c-e4ab-440b-bb06-900104e4a8b6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:22.995886 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f14d430c-e4ab-440b-bb06-900104e4a8b6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:22.996341 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f14d430c-e4ab-440b-bb06-900104e4a8b6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:23.006202 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f14d430c-e4ab-440b-bb06-900104e4a8b6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:23.006948 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f14d430c-e4ab-440b-bb06-900104e4a8b6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:23.150037 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8005e444-8ed0-4940-ae8f-40415d20ecb7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:23.150704 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8005e444-8ed0-4940-ae8f-40415d20ecb7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:23.172093 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8005e444-8ed0-4940-ae8f-40415d20ecb7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:23.173761 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8005e444-8ed0-4940-ae8f-40415d20ecb7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:23.176566 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8005e444-8ed0-4940-ae8f-40415d20ecb7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:23.177191 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8005e444-8ed0-4940-ae8f-40415d20ecb7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:23.622527 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f14d430c-e4ab-440b-bb06-900104e4a8b6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:23.645151 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f14d430c-e4ab-440b-bb06-900104e4a8b6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.658507 Apr 11 13:58:23.645800 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 167/325] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:22 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:23.697915 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-727e9b02-8545-4540-8057-0071197591a4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:23.698572 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-727e9b02-8545-4540-8057-0071197591a4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:23.710995 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-727e9b02-8545-4540-8057-0071197591a4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:23.726848 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-727e9b02-8545-4540-8057-0071197591a4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:23.730441 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-727e9b02-8545-4540-8057-0071197591a4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:23.730969 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-727e9b02-8545-4540-8057-0071197591a4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:23.993178 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8005e444-8ed0-4940-ae8f-40415d20ecb7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:24.004734 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8005e444-8ed0-4940-ae8f-40415d20ecb7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.858593 Apr 11 13:58:24.012384 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 159/326] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:23 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:24.069955 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-727e9b02-8545-4540-8057-0071197591a4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:24.080213 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-727e9b02-8545-4540-8057-0071197591a4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:24.082331 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-727e9b02-8545-4540-8057-0071197591a4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:24.084449 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-727e9b02-8545-4540-8057-0071197591a4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1752 microversion: 2.20 time: 0.419451 Apr 11 13:58:24.097447 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 168/327] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:23 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1752 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:24.662993 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4b49c79c-867a-4fd4-ba5d-793e5833044e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:24.664235 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4b49c79c-867a-4fd4-ba5d-793e5833044e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:24.678582 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b49c79c-867a-4fd4-ba5d-793e5833044e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:24.679293 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b49c79c-867a-4fd4-ba5d-793e5833044e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:24.680265 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b49c79c-867a-4fd4-ba5d-793e5833044e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:24.680865 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b49c79c-867a-4fd4-ba5d-793e5833044e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:25.018275 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4b49c79c-867a-4fd4-ba5d-793e5833044e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:25.031196 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9e8c981f-cb96-4082-9462-277b0e4d64de tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:25.032889 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9e8c981f-cb96-4082-9462-277b0e4d64de tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:25.033833 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4b49c79c-867a-4fd4-ba5d-793e5833044e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.374563 Apr 11 13:58:25.039843 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9e8c981f-cb96-4082-9462-277b0e4d64de tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:25.040811 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9e8c981f-cb96-4082-9462-277b0e4d64de tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:25.041227 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 160/328] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:24 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:25.042182 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9e8c981f-cb96-4082-9462-277b0e4d64de tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:25.042977 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9e8c981f-cb96-4082-9462-277b0e4d64de tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:25.105114 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d9e13556-164d-4b4a-ae7d-59c848298460 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:25.106605 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d9e13556-164d-4b4a-ae7d-59c848298460 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:25.122862 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9e13556-164d-4b4a-ae7d-59c848298460 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:25.123968 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9e13556-164d-4b4a-ae7d-59c848298460 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:25.125823 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9e13556-164d-4b4a-ae7d-59c848298460 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:25.126697 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9e13556-164d-4b4a-ae7d-59c848298460 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:25.337070 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9e8c981f-cb96-4082-9462-277b0e4d64de tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:25.349619 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9e8c981f-cb96-4082-9462-277b0e4d64de tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.324120 Apr 11 13:58:25.354383 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 169/329] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:25 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:25.546773 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d9e13556-164d-4b4a-ae7d-59c848298460 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:25.558224 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d9e13556-164d-4b4a-ae7d-59c848298460 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:25.572401 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d9e13556-164d-4b4a-ae7d-59c848298460 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:25.574042 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d9e13556-164d-4b4a-ae7d-59c848298460 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1752 microversion: 2.20 time: 0.473757 Apr 11 13:58:25.588602 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 161/330] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:25 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1752 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:26.051417 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1404697562", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "networks": [{"uuid": "cf99eff9-c390-41f8-af4b-89bf18e9fd64"}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:26.060629 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e4b66633-76f3-485e-a17a-d165ae76fac2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:26.062532 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e4b66633-76f3-485e-a17a-d165ae76fac2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:26.073636 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4b66633-76f3-485e-a17a-d165ae76fac2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:26.074475 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4b66633-76f3-485e-a17a-d165ae76fac2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:26.075518 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4b66633-76f3-485e-a17a-d165ae76fac2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:26.076215 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4b66633-76f3-485e-a17a-d165ae76fac2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:26.359936 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e4b66633-76f3-485e-a17a-d165ae76fac2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:26.375000 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e4b66633-76f3-485e-a17a-d165ae76fac2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.317891 Apr 11 13:58:26.377165 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 162/331] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:26 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:26.391430 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fdcc20d7-a8a6-4c44-be6b-f3315ed6925a tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:26.392630 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fdcc20d7-a8a6-4c44-be6b-f3315ed6925a tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:26.407147 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fdcc20d7-a8a6-4c44-be6b-f3315ed6925a tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:26.408161 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fdcc20d7-a8a6-4c44-be6b-f3315ed6925a tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:26.409573 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fdcc20d7-a8a6-4c44-be6b-f3315ed6925a tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:26.410329 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fdcc20d7-a8a6-4c44-be6b-f3315ed6925a tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:26.680430 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fdcc20d7-a8a6-4c44-be6b-f3315ed6925a tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:26.691310 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fdcc20d7-a8a6-4c44-be6b-f3315ed6925a tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.312729 Apr 11 13:58:26.692187 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 163/332] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:26 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:26.706379 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1b2d9d42-5d50-409f-b88e-d089dd270c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:26.707948 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1b2d9d42-5d50-409f-b88e-d089dd270c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:26.715779 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1b2d9d42-5d50-409f-b88e-d089dd270c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:26.716663 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1b2d9d42-5d50-409f-b88e-d089dd270c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:26.718953 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1b2d9d42-5d50-409f-b88e-d089dd270c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:26.719961 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1b2d9d42-5d50-409f-b88e-d089dd270c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:26.942634 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1b2d9d42-5d50-409f-b88e-d089dd270c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:26.961541 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1b2d9d42-5d50-409f-b88e-d089dd270c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:26.965250 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1b2d9d42-5d50-409f-b88e-d089dd270c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:26.970454 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1b2d9d42-5d50-409f-b88e-d089dd270c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.268286 Apr 11 13:58:26.972198 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 164/333] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:26 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:27.394766 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d10f3f3b-a2ff-437b-9949-dfd364c01c43 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:27.395479 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d10f3f3b-a2ff-437b-9949-dfd364c01c43 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:27.402389 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d10f3f3b-a2ff-437b-9949-dfd364c01c43 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:27.402917 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d10f3f3b-a2ff-437b-9949-dfd364c01c43 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:27.403758 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d10f3f3b-a2ff-437b-9949-dfd364c01c43 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:27.404266 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d10f3f3b-a2ff-437b-9949-dfd364c01c43 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:27.582271 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d10f3f3b-a2ff-437b-9949-dfd364c01c43 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:27.591145 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d10f3f3b-a2ff-437b-9949-dfd364c01c43 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.200131 Apr 11 13:58:27.591756 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 165/334] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:27 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:27.708585 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-049eccca-8728-4cd6-8ca9-48b2cf52393d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:27.709129 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-049eccca-8728-4cd6-8ca9-48b2cf52393d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:27.715586 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-049eccca-8728-4cd6-8ca9-48b2cf52393d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:27.716113 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-049eccca-8728-4cd6-8ca9-48b2cf52393d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:27.717118 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-049eccca-8728-4cd6-8ca9-48b2cf52393d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:27.717883 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-049eccca-8728-4cd6-8ca9-48b2cf52393d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:27.854635 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-049eccca-8728-4cd6-8ca9-48b2cf52393d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:27.862705 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-049eccca-8728-4cd6-8ca9-48b2cf52393d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.158168 Apr 11 13:58:27.863282 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 166/335] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:27 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:27.989729 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-20c88366-51ee-496f-9cc0-fe4325ae6d41 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:27.990265 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-20c88366-51ee-496f-9cc0-fe4325ae6d41 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:27.996113 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-20c88366-51ee-496f-9cc0-fe4325ae6d41 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:27.996561 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-20c88366-51ee-496f-9cc0-fe4325ae6d41 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:27.997333 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-20c88366-51ee-496f-9cc0-fe4325ae6d41 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:27.997765 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-20c88366-51ee-496f-9cc0-fe4325ae6d41 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:28.146129 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-20c88366-51ee-496f-9cc0-fe4325ae6d41 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:28.156028 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-20c88366-51ee-496f-9cc0-fe4325ae6d41 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:28.157551 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-20c88366-51ee-496f-9cc0-fe4325ae6d41 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:28.158771 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-20c88366-51ee-496f-9cc0-fe4325ae6d41 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.173158 Apr 11 13:58:28.160045 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 167/336] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:27 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:58:28.610101 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5f1a4e4b-7c1b-489a-815e-dab75a21d6ca tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:28.610777 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5f1a4e4b-7c1b-489a-815e-dab75a21d6ca tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:28.621096 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f1a4e4b-7c1b-489a-815e-dab75a21d6ca tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:28.621559 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f1a4e4b-7c1b-489a-815e-dab75a21d6ca tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:28.622343 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f1a4e4b-7c1b-489a-815e-dab75a21d6ca tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:28.622778 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f1a4e4b-7c1b-489a-815e-dab75a21d6ca tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:28.754899 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5f1a4e4b-7c1b-489a-815e-dab75a21d6ca tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:28.763140 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5f1a4e4b-7c1b-489a-815e-dab75a21d6ca tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.158187 Apr 11 13:58:28.763731 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 168/337] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:28 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:28.879927 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c9ccf129-e244-4aba-9474-a22998437f11 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:28.880544 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c9ccf129-e244-4aba-9474-a22998437f11 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:28.882819 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] validate_networks() for [('cf99eff9-c390-41f8-af4b-89bf18e9fd64', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 13:58:28.886638 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9ccf129-e244-4aba-9474-a22998437f11 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:28.887388 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9ccf129-e244-4aba-9474-a22998437f11 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:28.888452 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9ccf129-e244-4aba-9474-a22998437f11 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:28.889110 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9ccf129-e244-4aba-9474-a22998437f11 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:29.020369 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c9ccf129-e244-4aba-9474-a22998437f11 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:29.027920 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c9ccf129-e244-4aba-9474-a22998437f11 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.151709 Apr 11 13:58:29.028496 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 169/338] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:28 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:29.177577 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-342f0c57-f4dc-4a52-9f8e-53e3aec7926a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:29.178187 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-342f0c57-f4dc-4a52-9f8e-53e3aec7926a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:29.183898 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-342f0c57-f4dc-4a52-9f8e-53e3aec7926a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:29.184344 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-342f0c57-f4dc-4a52-9f8e-53e3aec7926a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:29.185105 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-342f0c57-f4dc-4a52-9f8e-53e3aec7926a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:29.185539 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-342f0c57-f4dc-4a52-9f8e-53e3aec7926a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:29.236318 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 13:58:29.236816 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 13:58:29.237406 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 13:58:29.237897 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 13:58:29.238451 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 13:58:29.248154 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:29.248603 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:29.249412 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:29.249852 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:29.268232 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Getting quotas for project 62982ff988ec462a8189ea9ba7c8496b. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:58:29.272539 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Getting quotas for user f57da915d2c14f1484f6a30c86d4eadd and project 62982ff988ec462a8189ea9ba7c8496b. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:58:29.284648 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 13:58:29.286945 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 13:58:29.318548 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-342f0c57-f4dc-4a52-9f8e-53e3aec7926a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:29.327055 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-342f0c57-f4dc-4a52-9f8e-53e3aec7926a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:29.329250 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-342f0c57-f4dc-4a52-9f8e-53e3aec7926a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:29.330413 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-342f0c57-f4dc-4a52-9f8e-53e3aec7926a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.156702 Apr 11 13:58:29.330978 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 170/339] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:29 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:58:29.334062 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9f146317-63c7-4dcf-814c-6f8b79a1ecd7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.288280 Apr 11 13:58:29.334755 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 170/340] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 13:58:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 13:58:29.346110 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7f09b279-d403-465d-8f0f-20438d2912c4 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:29.346737 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7f09b279-d403-465d-8f0f-20438d2912c4 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:29.418208 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7f09b279-d403-465d-8f0f-20438d2912c4 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:29.431372 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7f09b279-d403-465d-8f0f-20438d2912c4 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1219 microversion: 2.1 time: 0.085400 Apr 11 13:58:29.431372 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 171/341] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:29 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:29.780415 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6a8e5d6a-453d-40ed-a91d-341de14a549e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:29.781042 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6a8e5d6a-453d-40ed-a91d-341de14a549e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:29.787330 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6a8e5d6a-453d-40ed-a91d-341de14a549e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:29.787823 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6a8e5d6a-453d-40ed-a91d-341de14a549e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:29.788607 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6a8e5d6a-453d-40ed-a91d-341de14a549e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:29.789052 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6a8e5d6a-453d-40ed-a91d-341de14a549e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:29.915374 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6a8e5d6a-453d-40ed-a91d-341de14a549e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:29.923786 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6a8e5d6a-453d-40ed-a91d-341de14a549e tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.147232 Apr 11 13:58:29.924355 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 171/342] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:29 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:30.045940 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f70fef27-0341-4315-a583-b115a7c8b2e9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:30.046556 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f70fef27-0341-4315-a583-b115a7c8b2e9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:30.053152 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f70fef27-0341-4315-a583-b115a7c8b2e9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:30.053628 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f70fef27-0341-4315-a583-b115a7c8b2e9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:30.054506 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f70fef27-0341-4315-a583-b115a7c8b2e9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:30.055056 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f70fef27-0341-4315-a583-b115a7c8b2e9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:30.189376 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f70fef27-0341-4315-a583-b115a7c8b2e9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:30.196563 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f70fef27-0341-4315-a583-b115a7c8b2e9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.154486 Apr 11 13:58:30.197175 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 172/343] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:30 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:30.349071 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ff1dbc4a-21c5-4de9-9674-8bca3ba27918 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:30.349679 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ff1dbc4a-21c5-4de9-9674-8bca3ba27918 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:30.355458 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff1dbc4a-21c5-4de9-9674-8bca3ba27918 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:30.355945 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff1dbc4a-21c5-4de9-9674-8bca3ba27918 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:30.356695 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff1dbc4a-21c5-4de9-9674-8bca3ba27918 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:30.357125 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff1dbc4a-21c5-4de9-9674-8bca3ba27918 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:30.442529 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fde629c5-348b-4074-8ad6-e780c7f6e15c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:30.443148 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fde629c5-348b-4074-8ad6-e780c7f6e15c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:30.449105 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fde629c5-348b-4074-8ad6-e780c7f6e15c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:30.449553 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fde629c5-348b-4074-8ad6-e780c7f6e15c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:30.450312 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fde629c5-348b-4074-8ad6-e780c7f6e15c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:30.450743 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fde629c5-348b-4074-8ad6-e780c7f6e15c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:30.489506 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ff1dbc4a-21c5-4de9-9674-8bca3ba27918 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:30.497668 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ff1dbc4a-21c5-4de9-9674-8bca3ba27918 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:30.499166 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ff1dbc4a-21c5-4de9-9674-8bca3ba27918 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:30.500391 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ff1dbc4a-21c5-4de9-9674-8bca3ba27918 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.155190 Apr 11 13:58:30.501075 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 172/344] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:30 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:30.510579 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fde629c5-348b-4074-8ad6-e780c7f6e15c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:30.518072 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fde629c5-348b-4074-8ad6-e780c7f6e15c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1223 microversion: 2.1 time: 0.079313 Apr 11 13:58:30.518639 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 173/345] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:30 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:30.941281 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-859a6541-6107-4d1b-965f-1780a77b3501 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:30.941828 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-859a6541-6107-4d1b-965f-1780a77b3501 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:30.947931 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-859a6541-6107-4d1b-965f-1780a77b3501 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:30.948387 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-859a6541-6107-4d1b-965f-1780a77b3501 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:30.949160 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-859a6541-6107-4d1b-965f-1780a77b3501 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:30.949604 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-859a6541-6107-4d1b-965f-1780a77b3501 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:31.086764 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-859a6541-6107-4d1b-965f-1780a77b3501 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:31.094972 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-859a6541-6107-4d1b-965f-1780a77b3501 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.157603 Apr 11 13:58:31.095548 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 173/346] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:30 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:31.214368 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-018971c2-a2e5-4b67-9d6d-9229b60ac606 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:31.214923 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-018971c2-a2e5-4b67-9d6d-9229b60ac606 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:31.221610 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-018971c2-a2e5-4b67-9d6d-9229b60ac606 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:31.222057 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-018971c2-a2e5-4b67-9d6d-9229b60ac606 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:31.222843 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-018971c2-a2e5-4b67-9d6d-9229b60ac606 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:31.223272 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-018971c2-a2e5-4b67-9d6d-9229b60ac606 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:31.520709 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fcc3b95e-13bc-47d9-863e-b76a017fe2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:31.521882 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fcc3b95e-13bc-47d9-863e-b76a017fe2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:31.529932 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fcc3b95e-13bc-47d9-863e-b76a017fe2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:31.531328 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fcc3b95e-13bc-47d9-863e-b76a017fe2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:31.532697 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fcc3b95e-13bc-47d9-863e-b76a017fe2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:31.533373 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fcc3b95e-13bc-47d9-863e-b76a017fe2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:31.669811 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-018971c2-a2e5-4b67-9d6d-9229b60ac606 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:31.675407 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fcc3b95e-13bc-47d9-863e-b76a017fe2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:31.678160 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-018971c2-a2e5-4b67-9d6d-9229b60ac606 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.467731 Apr 11 13:58:31.678743 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 174/347] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:31 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:31.683574 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6423a4df-2b45-4c63-8838-6dd140cff854 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:31.684332 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6423a4df-2b45-4c63-8838-6dd140cff854 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:31.685034 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fcc3b95e-13bc-47d9-863e-b76a017fe2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:31.686790 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fcc3b95e-13bc-47d9-863e-b76a017fe2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:31.688812 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fcc3b95e-13bc-47d9-863e-b76a017fe2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.173414 Apr 11 13:58:31.690008 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 174/348] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:31 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:58:31.690662 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6423a4df-2b45-4c63-8838-6dd140cff854 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:31.691284 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6423a4df-2b45-4c63-8838-6dd140cff854 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:31.692234 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6423a4df-2b45-4c63-8838-6dd140cff854 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:31.692826 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6423a4df-2b45-4c63-8838-6dd140cff854 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:31.789760 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6423a4df-2b45-4c63-8838-6dd140cff854 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:31.799472 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6423a4df-2b45-4c63-8838-6dd140cff854 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1277 microversion: 2.1 time: 0.119469 Apr 11 13:58:31.800366 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 175/349] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:31 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1277 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:32.113019 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7e990282-4495-4065-ae16-0439620d2f13 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:32.114604 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7e990282-4495-4065-ae16-0439620d2f13 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:32.121759 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e990282-4495-4065-ae16-0439620d2f13 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:32.122214 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e990282-4495-4065-ae16-0439620d2f13 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:32.123173 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e990282-4495-4065-ae16-0439620d2f13 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:32.123621 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e990282-4495-4065-ae16-0439620d2f13 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:32.283141 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7e990282-4495-4065-ae16-0439620d2f13 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:32.291503 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7e990282-4495-4065-ae16-0439620d2f13 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.183345 Apr 11 13:58:32.313531 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 175/350] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:32 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:32.694662 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-760f3fab-464c-486d-96c5-162b41599ae7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:32.701438 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-760f3fab-464c-486d-96c5-162b41599ae7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:32.708416 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e1cb2d17-42b9-4182-85f1-8f237e4f490c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:32.709305 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e1cb2d17-42b9-4182-85f1-8f237e4f490c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:32.720585 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e1cb2d17-42b9-4182-85f1-8f237e4f490c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:32.721814 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-760f3fab-464c-486d-96c5-162b41599ae7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:32.722446 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e1cb2d17-42b9-4182-85f1-8f237e4f490c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:32.723080 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-760f3fab-464c-486d-96c5-162b41599ae7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:32.724529 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-760f3fab-464c-486d-96c5-162b41599ae7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:32.725264 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e1cb2d17-42b9-4182-85f1-8f237e4f490c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:32.725861 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e1cb2d17-42b9-4182-85f1-8f237e4f490c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:32.729355 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-760f3fab-464c-486d-96c5-162b41599ae7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:32.988684 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e1cb2d17-42b9-4182-85f1-8f237e4f490c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:32.998810 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e1cb2d17-42b9-4182-85f1-8f237e4f490c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:33.001881 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e1cb2d17-42b9-4182-85f1-8f237e4f490c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:33.004637 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e1cb2d17-42b9-4182-85f1-8f237e4f490c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.299176 Apr 11 13:58:33.005633 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 176/351] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:32 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:33.010432 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f676f651-238e-4973-b4d3-4be6d2e45358 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:33.011313 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f676f651-238e-4973-b4d3-4be6d2e45358 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:33.017866 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f676f651-238e-4973-b4d3-4be6d2e45358 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:33.018562 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f676f651-238e-4973-b4d3-4be6d2e45358 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:33.019873 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f676f651-238e-4973-b4d3-4be6d2e45358 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:33.020470 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f676f651-238e-4973-b4d3-4be6d2e45358 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:33.071224 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-760f3fab-464c-486d-96c5-162b41599ae7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:33.089969 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-760f3fab-464c-486d-96c5-162b41599ae7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.399189 Apr 11 13:58:33.100839 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 176/352] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:32 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:33.233237 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f676f651-238e-4973-b4d3-4be6d2e45358 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:33.241765 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f676f651-238e-4973-b4d3-4be6d2e45358 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.234859 Apr 11 13:58:33.245507 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 177/353] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:33 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:33.311415 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-91a7a111-2ce3-468f-91a8-f36a916ebf24 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:33.313010 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-91a7a111-2ce3-468f-91a8-f36a916ebf24 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:33.322672 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-91a7a111-2ce3-468f-91a8-f36a916ebf24 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:33.323469 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-91a7a111-2ce3-468f-91a8-f36a916ebf24 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:33.324511 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-91a7a111-2ce3-468f-91a8-f36a916ebf24 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:33.325232 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-91a7a111-2ce3-468f-91a8-f36a916ebf24 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:33.532166 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-91a7a111-2ce3-468f-91a8-f36a916ebf24 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:33.541763 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-91a7a111-2ce3-468f-91a8-f36a916ebf24 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.235005 Apr 11 13:58:33.542722 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 177/354] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:33 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:34.024500 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-003fc835-78e4-4959-a8b9-9068382aa6d3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:34.025127 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-003fc835-78e4-4959-a8b9-9068382aa6d3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:34.031542 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-003fc835-78e4-4959-a8b9-9068382aa6d3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:34.032027 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-003fc835-78e4-4959-a8b9-9068382aa6d3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:34.032812 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-003fc835-78e4-4959-a8b9-9068382aa6d3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:34.033253 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-003fc835-78e4-4959-a8b9-9068382aa6d3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:34.108617 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-aff3d8b7-7785-469f-8c15-1900bfc7ff49 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:34.110276 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-aff3d8b7-7785-469f-8c15-1900bfc7ff49 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:34.117049 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aff3d8b7-7785-469f-8c15-1900bfc7ff49 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:34.117559 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aff3d8b7-7785-469f-8c15-1900bfc7ff49 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:34.118254 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aff3d8b7-7785-469f-8c15-1900bfc7ff49 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:34.118854 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aff3d8b7-7785-469f-8c15-1900bfc7ff49 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:34.192867 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-003fc835-78e4-4959-a8b9-9068382aa6d3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:34.201448 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-003fc835-78e4-4959-a8b9-9068382aa6d3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:34.204007 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-003fc835-78e4-4959-a8b9-9068382aa6d3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:34.205534 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-003fc835-78e4-4959-a8b9-9068382aa6d3 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.184864 Apr 11 13:58:34.206681 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 178/355] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:34 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:34.261103 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ebbd197e-b658-4631-b35b-9b43f9a478a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:34.266368 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ebbd197e-b658-4631-b35b-9b43f9a478a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:34.270132 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-aff3d8b7-7785-469f-8c15-1900bfc7ff49 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:34.278984 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-aff3d8b7-7785-469f-8c15-1900bfc7ff49 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.174570 Apr 11 13:58:34.279284 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ebbd197e-b658-4631-b35b-9b43f9a478a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:34.279584 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 178/356] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:34 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:34.280621 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ebbd197e-b658-4631-b35b-9b43f9a478a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:34.281762 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ebbd197e-b658-4631-b35b-9b43f9a478a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:34.282284 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ebbd197e-b658-4631-b35b-9b43f9a478a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:34.431929 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ebbd197e-b658-4631-b35b-9b43f9a478a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:34.440850 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ebbd197e-b658-4631-b35b-9b43f9a478a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.183606 Apr 11 13:58:34.441373 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 179/357] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:34 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:34.559575 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-36e6e192-a517-4712-ad9a-485117173ce6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:34.560540 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-36e6e192-a517-4712-ad9a-485117173ce6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:34.585528 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-36e6e192-a517-4712-ad9a-485117173ce6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:34.586266 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-36e6e192-a517-4712-ad9a-485117173ce6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:34.587243 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-36e6e192-a517-4712-ad9a-485117173ce6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:34.587986 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-36e6e192-a517-4712-ad9a-485117173ce6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:34.752489 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-36e6e192-a517-4712-ad9a-485117173ce6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:34.762019 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-36e6e192-a517-4712-ad9a-485117173ce6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.206252 Apr 11 13:58:34.762665 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 179/358] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:34 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:34.802481 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-976b67bc-f741-42dd-af85-dca90c6f4e1a req-fbd791f1-961a-4ea8-8f2b-23bf7b6f7a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79569212-4835-45da-92b0-516e527a1f88", "name": "network-vif-plugged", "status": "completed", "tag": "696c428a-2d32-4149-b9c4-40a4e382593e"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:34.811800 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-976b67bc-f741-42dd-af85-dca90c6f4e1a req-fbd791f1-961a-4ea8-8f2b-23bf7b6f7a81 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:34.812516 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-976b67bc-f741-42dd-af85-dca90c6f4e1a req-fbd791f1-961a-4ea8-8f2b-23bf7b6f7a81 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:34.824088 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-976b67bc-f741-42dd-af85-dca90c6f4e1a req-fbd791f1-961a-4ea8-8f2b-23bf7b6f7a81 service nova] Creating event network-vif-plugged:696c428a-2d32-4149-b9c4-40a4e382593e for instance 79569212-4835-45da-92b0-516e527a1f88 on hv-cinder-83078 Apr 11 13:58:34.829142 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-976b67bc-f741-42dd-af85-dca90c6f4e1a req-fbd791f1-961a-4ea8-8f2b-23bf7b6f7a81 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030630 Apr 11 13:58:34.830277 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 180/359] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:58:35.227788 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-67d1405b-442f-4b21-acef-6ea5bb3db984 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:35.229195 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-67d1405b-442f-4b21-acef-6ea5bb3db984 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:35.236496 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67d1405b-442f-4b21-acef-6ea5bb3db984 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:35.237056 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67d1405b-442f-4b21-acef-6ea5bb3db984 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:35.237912 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67d1405b-442f-4b21-acef-6ea5bb3db984 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:35.238355 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67d1405b-442f-4b21-acef-6ea5bb3db984 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:35.298492 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a366dd00-3831-4c46-95f0-8a90302fcb98 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:35.299571 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a366dd00-3831-4c46-95f0-8a90302fcb98 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:35.306960 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a366dd00-3831-4c46-95f0-8a90302fcb98 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:35.307947 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a366dd00-3831-4c46-95f0-8a90302fcb98 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:35.308960 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a366dd00-3831-4c46-95f0-8a90302fcb98 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:35.309471 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a366dd00-3831-4c46-95f0-8a90302fcb98 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:35.386972 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-67d1405b-442f-4b21-acef-6ea5bb3db984 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:35.396921 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-67d1405b-442f-4b21-acef-6ea5bb3db984 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:35.398726 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-67d1405b-442f-4b21-acef-6ea5bb3db984 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:35.400217 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-67d1405b-442f-4b21-acef-6ea5bb3db984 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.177144 Apr 11 13:58:35.411093 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 180/360] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:35 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:35.458160 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-88a4255e-b692-490a-99f6-2ae8dbd488d0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:35.458788 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-88a4255e-b692-490a-99f6-2ae8dbd488d0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:35.466123 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88a4255e-b692-490a-99f6-2ae8dbd488d0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:35.466578 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88a4255e-b692-490a-99f6-2ae8dbd488d0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:35.474990 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88a4255e-b692-490a-99f6-2ae8dbd488d0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:35.475446 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88a4255e-b692-490a-99f6-2ae8dbd488d0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:35.502370 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a366dd00-3831-4c46-95f0-8a90302fcb98 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:35.511611 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a366dd00-3831-4c46-95f0-8a90302fcb98 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.218648 Apr 11 13:58:35.512491 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 181/361] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:35 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:35.619525 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-88a4255e-b692-490a-99f6-2ae8dbd488d0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:35.627558 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-88a4255e-b692-490a-99f6-2ae8dbd488d0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.173109 Apr 11 13:58:35.628171 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 181/362] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:35 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:35.779903 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-91e2c12e-44b0-4ea2-8551-fa804c60c0f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:35.780544 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-91e2c12e-44b0-4ea2-8551-fa804c60c0f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:35.786715 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-91e2c12e-44b0-4ea2-8551-fa804c60c0f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:35.787254 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-91e2c12e-44b0-4ea2-8551-fa804c60c0f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:35.788122 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-91e2c12e-44b0-4ea2-8551-fa804c60c0f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:35.788622 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-91e2c12e-44b0-4ea2-8551-fa804c60c0f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:35.928730 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-91e2c12e-44b0-4ea2-8551-fa804c60c0f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:35.938205 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-91e2c12e-44b0-4ea2-8551-fa804c60c0f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.161465 Apr 11 13:58:35.938795 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 182/363] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:35 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:36.419079 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a427c07a-04d8-4503-9124-932011c5054d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:36.419829 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a427c07a-04d8-4503-9124-932011c5054d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:36.427584 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a427c07a-04d8-4503-9124-932011c5054d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:36.428064 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a427c07a-04d8-4503-9124-932011c5054d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:36.428864 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a427c07a-04d8-4503-9124-932011c5054d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:36.429304 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a427c07a-04d8-4503-9124-932011c5054d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:36.530474 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-61b62f1b-2810-4c8a-9c6d-1cd193a93c2c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:36.532661 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-61b62f1b-2810-4c8a-9c6d-1cd193a93c2c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:36.539785 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-61b62f1b-2810-4c8a-9c6d-1cd193a93c2c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:36.540353 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-61b62f1b-2810-4c8a-9c6d-1cd193a93c2c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:36.541200 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-61b62f1b-2810-4c8a-9c6d-1cd193a93c2c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:36.541872 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-61b62f1b-2810-4c8a-9c6d-1cd193a93c2c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:36.574735 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a427c07a-04d8-4503-9124-932011c5054d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:36.583619 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a427c07a-04d8-4503-9124-932011c5054d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:36.585512 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a427c07a-04d8-4503-9124-932011c5054d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:36.586955 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a427c07a-04d8-4503-9124-932011c5054d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.172594 Apr 11 13:58:36.587588 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 182/364] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:36 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:36.650092 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d4cee0ad-5427-4719-9698-4b17e9a5f501 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:36.650705 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d4cee0ad-5427-4719-9698-4b17e9a5f501 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:36.657594 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d4cee0ad-5427-4719-9698-4b17e9a5f501 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:36.658047 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d4cee0ad-5427-4719-9698-4b17e9a5f501 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:36.658821 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d4cee0ad-5427-4719-9698-4b17e9a5f501 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:36.659254 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d4cee0ad-5427-4719-9698-4b17e9a5f501 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:36.691834 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-61b62f1b-2810-4c8a-9c6d-1cd193a93c2c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:36.699692 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-61b62f1b-2810-4c8a-9c6d-1cd193a93c2c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.172873 Apr 11 13:58:36.700574 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 183/365] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:36 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:36.821528 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d4cee0ad-5427-4719-9698-4b17e9a5f501 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:36.829343 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d4cee0ad-5427-4719-9698-4b17e9a5f501 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.182918 Apr 11 13:58:36.829908 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 183/366] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:36 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:36.956455 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-493c0674-28a3-4964-a544-b5d0a8c224ea tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:36.957256 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-493c0674-28a3-4964-a544-b5d0a8c224ea tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:36.963585 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-493c0674-28a3-4964-a544-b5d0a8c224ea tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:36.964148 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-493c0674-28a3-4964-a544-b5d0a8c224ea tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:36.965000 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-493c0674-28a3-4964-a544-b5d0a8c224ea tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:36.965549 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-493c0674-28a3-4964-a544-b5d0a8c224ea tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:37.125997 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-493c0674-28a3-4964-a544-b5d0a8c224ea tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:37.134496 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-493c0674-28a3-4964-a544-b5d0a8c224ea tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.182019 Apr 11 13:58:37.135658 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 184/367] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:36 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:37.607595 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-05eeb427-ae58-4a78-8c1a-19f95aeaf788 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:37.609885 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-05eeb427-ae58-4a78-8c1a-19f95aeaf788 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:37.616712 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-05eeb427-ae58-4a78-8c1a-19f95aeaf788 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:37.617246 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-05eeb427-ae58-4a78-8c1a-19f95aeaf788 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:37.618097 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-05eeb427-ae58-4a78-8c1a-19f95aeaf788 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:37.618622 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-05eeb427-ae58-4a78-8c1a-19f95aeaf788 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:37.718093 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2598649f-8b1e-4082-97a4-826bfc97317c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:37.718964 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2598649f-8b1e-4082-97a4-826bfc97317c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:37.726127 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2598649f-8b1e-4082-97a4-826bfc97317c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:37.726822 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2598649f-8b1e-4082-97a4-826bfc97317c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:37.727923 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2598649f-8b1e-4082-97a4-826bfc97317c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:37.728605 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2598649f-8b1e-4082-97a4-826bfc97317c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:37.792942 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-05eeb427-ae58-4a78-8c1a-19f95aeaf788 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:37.801876 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-05eeb427-ae58-4a78-8c1a-19f95aeaf788 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:37.803449 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-05eeb427-ae58-4a78-8c1a-19f95aeaf788 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:37.807446 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-05eeb427-ae58-4a78-8c1a-19f95aeaf788 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.202082 Apr 11 13:58:37.808133 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 184/368] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:37 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:37.858407 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-098f5ea3-d30a-45a4-b9bb-a28644a8d03e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:37.859679 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-098f5ea3-d30a-45a4-b9bb-a28644a8d03e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:37.867135 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-098f5ea3-d30a-45a4-b9bb-a28644a8d03e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:37.868125 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-098f5ea3-d30a-45a4-b9bb-a28644a8d03e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:37.869168 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-098f5ea3-d30a-45a4-b9bb-a28644a8d03e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:37.869824 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-098f5ea3-d30a-45a4-b9bb-a28644a8d03e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:37.900886 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2598649f-8b1e-4082-97a4-826bfc97317c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:37.910100 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2598649f-8b1e-4082-97a4-826bfc97317c tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.195710 Apr 11 13:58:37.919315 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 185/369] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:37 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:38.013399 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-098f5ea3-d30a-45a4-b9bb-a28644a8d03e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:38.021646 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-098f5ea3-d30a-45a4-b9bb-a28644a8d03e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.175249 Apr 11 13:58:38.022230 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 185/370] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:37 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:38.155672 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4d478d6e-e36d-44a5-aefd-9be6ff4ea721 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:38.156279 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4d478d6e-e36d-44a5-aefd-9be6ff4ea721 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:38.163077 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d478d6e-e36d-44a5-aefd-9be6ff4ea721 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:38.163524 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d478d6e-e36d-44a5-aefd-9be6ff4ea721 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:38.164610 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d478d6e-e36d-44a5-aefd-9be6ff4ea721 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:38.165049 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d478d6e-e36d-44a5-aefd-9be6ff4ea721 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:38.298912 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4d478d6e-e36d-44a5-aefd-9be6ff4ea721 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:38.307654 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4d478d6e-e36d-44a5-aefd-9be6ff4ea721 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.156400 Apr 11 13:58:38.308225 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 186/371] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:38 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:38.826784 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-60825a93-f4de-4e6c-98c2-20005ac1560b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:38.828301 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-60825a93-f4de-4e6c-98c2-20005ac1560b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:38.835501 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-60825a93-f4de-4e6c-98c2-20005ac1560b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:38.835985 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-60825a93-f4de-4e6c-98c2-20005ac1560b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:38.836759 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-60825a93-f4de-4e6c-98c2-20005ac1560b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:38.837195 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-60825a93-f4de-4e6c-98c2-20005ac1560b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:38.926748 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e68c30ce-126d-4050-93c5-08f3d6e64566 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:38.928196 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e68c30ce-126d-4050-93c5-08f3d6e64566 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:38.935757 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e68c30ce-126d-4050-93c5-08f3d6e64566 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:38.936365 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e68c30ce-126d-4050-93c5-08f3d6e64566 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:38.938220 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e68c30ce-126d-4050-93c5-08f3d6e64566 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:38.939011 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e68c30ce-126d-4050-93c5-08f3d6e64566 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:38.979466 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-60825a93-f4de-4e6c-98c2-20005ac1560b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:38.996352 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-60825a93-f4de-4e6c-98c2-20005ac1560b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:38.998890 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-60825a93-f4de-4e6c-98c2-20005ac1560b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:39.000702 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-60825a93-f4de-4e6c-98c2-20005ac1560b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.178027 Apr 11 13:58:39.001456 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 186/372] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:38 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:39.039595 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6bf5c2d9-4916-4e9b-b73a-382551a8d947 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:39.040251 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6bf5c2d9-4916-4e9b-b73a-382551a8d947 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:39.047028 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6bf5c2d9-4916-4e9b-b73a-382551a8d947 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:39.047482 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6bf5c2d9-4916-4e9b-b73a-382551a8d947 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:39.048314 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6bf5c2d9-4916-4e9b-b73a-382551a8d947 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:39.048752 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6bf5c2d9-4916-4e9b-b73a-382551a8d947 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:39.082445 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e68c30ce-126d-4050-93c5-08f3d6e64566 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:39.089929 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e68c30ce-126d-4050-93c5-08f3d6e64566 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.167019 Apr 11 13:58:39.090718 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 187/373] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:38 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:39.191906 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6bf5c2d9-4916-4e9b-b73a-382551a8d947 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:39.208618 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6bf5c2d9-4916-4e9b-b73a-382551a8d947 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.172995 Apr 11 13:58:39.209277 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 187/374] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:39 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:39.329592 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cef6c5ce-6c38-4e34-86ee-2bfb1afb03d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:39.330282 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cef6c5ce-6c38-4e34-86ee-2bfb1afb03d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:39.336366 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cef6c5ce-6c38-4e34-86ee-2bfb1afb03d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:39.336820 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cef6c5ce-6c38-4e34-86ee-2bfb1afb03d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:39.337887 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cef6c5ce-6c38-4e34-86ee-2bfb1afb03d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:39.338549 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cef6c5ce-6c38-4e34-86ee-2bfb1afb03d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:39.484872 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cef6c5ce-6c38-4e34-86ee-2bfb1afb03d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:39.496481 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cef6c5ce-6c38-4e34-86ee-2bfb1afb03d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.172851 Apr 11 13:58:39.497249 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 188/375] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:39 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:40.020135 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b0ee8692-e311-47ee-9187-f9a9e5d03731 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:40.020914 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b0ee8692-e311-47ee-9187-f9a9e5d03731 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:40.027806 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b0ee8692-e311-47ee-9187-f9a9e5d03731 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:40.028259 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b0ee8692-e311-47ee-9187-f9a9e5d03731 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:40.029053 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b0ee8692-e311-47ee-9187-f9a9e5d03731 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:40.029543 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b0ee8692-e311-47ee-9187-f9a9e5d03731 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:40.107583 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a0b18b1a-d888-4d89-bd10-afbd8028c3b9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:40.108400 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a0b18b1a-d888-4d89-bd10-afbd8028c3b9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:40.118702 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0b18b1a-d888-4d89-bd10-afbd8028c3b9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:40.119252 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0b18b1a-d888-4d89-bd10-afbd8028c3b9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:40.120156 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0b18b1a-d888-4d89-bd10-afbd8028c3b9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:40.120683 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0b18b1a-d888-4d89-bd10-afbd8028c3b9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:40.177893 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b0ee8692-e311-47ee-9187-f9a9e5d03731 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:40.186300 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b0ee8692-e311-47ee-9187-f9a9e5d03731 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:40.188345 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b0ee8692-e311-47ee-9187-f9a9e5d03731 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:40.189760 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b0ee8692-e311-47ee-9187-f9a9e5d03731 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.173856 Apr 11 13:58:40.190651 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 188/376] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:40 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:40.228224 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a1f56a84-8ccf-4650-9c4e-e6c0eb7ae536 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:40.228949 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a1f56a84-8ccf-4650-9c4e-e6c0eb7ae536 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:40.236046 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a1f56a84-8ccf-4650-9c4e-e6c0eb7ae536 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:40.236678 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a1f56a84-8ccf-4650-9c4e-e6c0eb7ae536 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:40.237738 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a1f56a84-8ccf-4650-9c4e-e6c0eb7ae536 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:40.238286 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a1f56a84-8ccf-4650-9c4e-e6c0eb7ae536 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:40.298807 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a0b18b1a-d888-4d89-bd10-afbd8028c3b9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:40.308964 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a0b18b1a-d888-4d89-bd10-afbd8028c3b9 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.204954 Apr 11 13:58:40.311965 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 189/377] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:40 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:40.410361 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a1f56a84-8ccf-4650-9c4e-e6c0eb7ae536 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:40.418375 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a1f56a84-8ccf-4650-9c4e-e6c0eb7ae536 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.193851 Apr 11 13:58:40.418810 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 189/378] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:40 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:40.515708 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8b87177f-4b8b-4cce-b701-b2327685e52d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:40.516012 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8b87177f-4b8b-4cce-b701-b2327685e52d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:40.529071 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b87177f-4b8b-4cce-b701-b2327685e52d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:40.529521 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b87177f-4b8b-4cce-b701-b2327685e52d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:40.531028 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b87177f-4b8b-4cce-b701-b2327685e52d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:40.531968 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b87177f-4b8b-4cce-b701-b2327685e52d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:40.670701 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8b87177f-4b8b-4cce-b701-b2327685e52d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:40.678873 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8b87177f-4b8b-4cce-b701-b2327685e52d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1723 microversion: 2.1 time: 0.168099 Apr 11 13:58:40.679462 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 190/379] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:40 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:41.208392 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-90af3102-972e-4f99-8712-4e7723d2550a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:41.208985 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-90af3102-972e-4f99-8712-4e7723d2550a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:41.215204 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-90af3102-972e-4f99-8712-4e7723d2550a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:41.215671 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-90af3102-972e-4f99-8712-4e7723d2550a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:41.216426 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-90af3102-972e-4f99-8712-4e7723d2550a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:41.216849 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-90af3102-972e-4f99-8712-4e7723d2550a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:41.318874 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-351995033", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1579021211", "security_groups": [{"name": "tempest-secgroup-smoke-1621294779"}], "networks": [{"uuid": "bcc3856a-1e27-4d38-8f1d-e24f8fbb1282"}], "block_device_mapping_v2": [{"uuid": "44eed89e-22cc-4924-a760-ea4a6dd0dd6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:41.354140 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-90af3102-972e-4f99-8712-4e7723d2550a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:41.362901 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-90af3102-972e-4f99-8712-4e7723d2550a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:41.364440 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-90af3102-972e-4f99-8712-4e7723d2550a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:41.365539 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-90af3102-972e-4f99-8712-4e7723d2550a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.161175 Apr 11 13:58:41.366088 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 190/380] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:41 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:58:41.370351 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-79a4e46d-aee4-4f89-90e1-7703b1f19753 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:41.370946 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-79a4e46d-aee4-4f89-90e1-7703b1f19753 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:41.377259 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-79a4e46d-aee4-4f89-90e1-7703b1f19753 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:41.377869 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-79a4e46d-aee4-4f89-90e1-7703b1f19753 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:41.378657 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-79a4e46d-aee4-4f89-90e1-7703b1f19753 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:41.379098 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-79a4e46d-aee4-4f89-90e1-7703b1f19753 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:41.431750 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] validate_networks() for [('bcc3856a-1e27-4d38-8f1d-e24f8fbb1282', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 13:58:41.550875 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-79a4e46d-aee4-4f89-90e1-7703b1f19753 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:41.559786 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-79a4e46d-aee4-4f89-90e1-7703b1f19753 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.192638 Apr 11 13:58:41.560380 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 191/381] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:41 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:41.565625 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e7e47e38-4a63-4fb6-aa2f-e62b50057796 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:41.566272 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e7e47e38-4a63-4fb6-aa2f-e62b50057796 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:41.572214 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e7e47e38-4a63-4fb6-aa2f-e62b50057796 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:41.572663 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e7e47e38-4a63-4fb6-aa2f-e62b50057796 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:41.573436 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e7e47e38-4a63-4fb6-aa2f-e62b50057796 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:41.573927 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e7e47e38-4a63-4fb6-aa2f-e62b50057796 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:41.833604 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 13:58:41.836717 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e7e47e38-4a63-4fb6-aa2f-e62b50057796 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:41.840213 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 13:58:41.840794 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 13:58:41.841328 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 13:58:41.841768 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 13:58:41.847787 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e7e47e38-4a63-4fb6-aa2f-e62b50057796 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.286359 Apr 11 13:58:41.848385 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 192/382] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:41 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:41.855071 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9058f082-f07c-47d4-bbf4-6ff0b3a1f08f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:41.855871 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9058f082-f07c-47d4-bbf4-6ff0b3a1f08f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:41.858038 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:41.859093 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:41.859889 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:41.860330 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:41.862938 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9058f082-f07c-47d4-bbf4-6ff0b3a1f08f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:41.863475 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9058f082-f07c-47d4-bbf4-6ff0b3a1f08f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:41.864245 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9058f082-f07c-47d4-bbf4-6ff0b3a1f08f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:41.864692 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9058f082-f07c-47d4-bbf4-6ff0b3a1f08f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:41.877949 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Getting quotas for project 626d5ba1efe34953a6d00b0f0afd5013. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:58:41.881831 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Getting quotas for user 4fd5089d5b5d4f71b5789cc10b7ff971 and project 626d5ba1efe34953a6d00b0f0afd5013. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:58:41.939461 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 13:58:41.941737 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='44eed89e-22cc-4924-a760-ea4a6dd0dd6b',volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 13:58:42.048814 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9058f082-f07c-47d4-bbf4-6ff0b3a1f08f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:42.057774 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9058f082-f07c-47d4-bbf4-6ff0b3a1f08f tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1700 microversion: 2.1 time: 0.208161 Apr 11 13:58:42.058459 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 193/383] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:41 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1700 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:42.076406 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ebd67dd8-4129-49da-a516-581c4122e5b6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:42.077849 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a74e9555-dbbf-483d-81f6-384c77ad8267 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762588 Apr 11 13:58:42.078903 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 191/384] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 13:58:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 11 13:58:42.098128 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ebd67dd8-4129-49da-a516-581c4122e5b6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:42.098628 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ebd67dd8-4129-49da-a516-581c4122e5b6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:42.104540 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0f379d5d-9283-4f5a-aa04-97bb263eff34 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:42.105808 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0f379d5d-9283-4f5a-aa04-97bb263eff34 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:42.183602 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ebd67dd8-4129-49da-a516-581c4122e5b6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Going to try to start instance {{(pid=116942) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 11 13:58:42.186466 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0f379d5d-9283-4f5a-aa04-97bb263eff34 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:42.193846 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0f379d5d-9283-4f5a-aa04-97bb263eff34 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1088 microversion: 2.1 time: 0.108706 Apr 11 13:58:42.194817 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 192/385] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:42 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1088 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:42.241056 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ebd67dd8-4129-49da-a516-581c4122e5b6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "POST /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/action" status: 202 len: 0 microversion: 2.1 time: 0.169074 Apr 11 13:58:42.242074 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 194/386] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 13:58:42 2022] POST /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 13:58:42.249691 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c32a1938-4a96-4160-8571-0b5a9e08b8a7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:42.250425 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c32a1938-4a96-4160-8571-0b5a9e08b8a7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:42.257219 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c32a1938-4a96-4160-8571-0b5a9e08b8a7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:42.257676 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c32a1938-4a96-4160-8571-0b5a9e08b8a7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:42.258453 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c32a1938-4a96-4160-8571-0b5a9e08b8a7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:42.258984 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c32a1938-4a96-4160-8571-0b5a9e08b8a7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:42.390445 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9d243061-089b-4733-98b4-9c6cc9737c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:42.391733 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9d243061-089b-4733-98b4-9c6cc9737c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:42.404277 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9d243061-089b-4733-98b4-9c6cc9737c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:42.405011 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9d243061-089b-4733-98b4-9c6cc9737c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:42.406533 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9d243061-089b-4733-98b4-9c6cc9737c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:42.407402 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9d243061-089b-4733-98b4-9c6cc9737c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:42.453260 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c32a1938-4a96-4160-8571-0b5a9e08b8a7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:42.462559 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c32a1938-4a96-4160-8571-0b5a9e08b8a7 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1709 microversion: 2.1 time: 0.216554 Apr 11 13:58:42.463533 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 193/387] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:42 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1709 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:42.577950 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a758b19e-b853-4d4b-8150-5ac4e02613aa tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:42.578662 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a758b19e-b853-4d4b-8150-5ac4e02613aa tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:42.585291 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a758b19e-b853-4d4b-8150-5ac4e02613aa tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:42.585855 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a758b19e-b853-4d4b-8150-5ac4e02613aa tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:42.586719 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a758b19e-b853-4d4b-8150-5ac4e02613aa tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:42.587228 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a758b19e-b853-4d4b-8150-5ac4e02613aa tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:42.646604 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9d243061-089b-4733-98b4-9c6cc9737c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:42.660161 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9d243061-089b-4733-98b4-9c6cc9737c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:42.661986 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9d243061-089b-4733-98b4-9c6cc9737c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:42.663359 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9d243061-089b-4733-98b4-9c6cc9737c01 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.282759 Apr 11 13:58:42.665712 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 195/388] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:42 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:42.681601 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-e901fd13-f79f-445d-b3de-3e15032f4488 req-f31f612c-eaa4-4657-aec0-3b39ae7c162a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94420324-3720-447d-b195-df28fb7d8fc7", "tag": "ff4c3178-c740-4cea-87a2-4bed198b02e0"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:42.692713 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-e901fd13-f79f-445d-b3de-3e15032f4488 req-f31f612c-eaa4-4657-aec0-3b39ae7c162a service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:42.693541 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-e901fd13-f79f-445d-b3de-3e15032f4488 req-f31f612c-eaa4-4657-aec0-3b39ae7c162a service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:42.715563 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-e901fd13-f79f-445d-b3de-3e15032f4488 req-f31f612c-eaa4-4657-aec0-3b39ae7c162a service nova] Creating event network-changed:ff4c3178-c740-4cea-87a2-4bed198b02e0 for instance 94420324-3720-447d-b195-df28fb7d8fc7 on hv-cinder-83078 Apr 11 13:58:42.722125 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-e901fd13-f79f-445d-b3de-3e15032f4488 req-f31f612c-eaa4-4657-aec0-3b39ae7c162a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045773 Apr 11 13:58:42.723327 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 196/389] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 13:58:42.765238 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a758b19e-b853-4d4b-8150-5ac4e02613aa tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:42.772714 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a758b19e-b853-4d4b-8150-5ac4e02613aa tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.199462 Apr 11 13:58:42.773283 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 194/390] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:42 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:42.865245 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-45faff31-e271-4333-8468-3bd2bb24a0d4 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:42.865936 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-45faff31-e271-4333-8468-3bd2bb24a0d4 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:42.871994 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-45faff31-e271-4333-8468-3bd2bb24a0d4 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:42.872441 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-45faff31-e271-4333-8468-3bd2bb24a0d4 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:42.873186 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-45faff31-e271-4333-8468-3bd2bb24a0d4 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:42.873644 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-45faff31-e271-4333-8468-3bd2bb24a0d4 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:43.054046 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-45faff31-e271-4333-8468-3bd2bb24a0d4 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:43.061171 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-45faff31-e271-4333-8468-3bd2bb24a0d4 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.200097 Apr 11 13:58:43.061759 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 197/391] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:42 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:43.210720 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c5250641-6464-4711-a346-7a856eecef79 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:43.211253 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c5250641-6464-4711-a346-7a856eecef79 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:43.217123 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c5250641-6464-4711-a346-7a856eecef79 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:43.218133 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c5250641-6464-4711-a346-7a856eecef79 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:43.219045 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c5250641-6464-4711-a346-7a856eecef79 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:43.219496 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c5250641-6464-4711-a346-7a856eecef79 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:43.277383 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c5250641-6464-4711-a346-7a856eecef79 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:43.285185 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c5250641-6464-4711-a346-7a856eecef79 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1130 microversion: 2.1 time: 0.078384 Apr 11 13:58:43.285756 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 195/392] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:43 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1130 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:43.481312 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-37dc9c35-588b-4cbf-a530-c3215d2a73c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:43.481925 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-37dc9c35-588b-4cbf-a530-c3215d2a73c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:43.488144 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37dc9c35-588b-4cbf-a530-c3215d2a73c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:43.488784 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37dc9c35-588b-4cbf-a530-c3215d2a73c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:43.490168 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37dc9c35-588b-4cbf-a530-c3215d2a73c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:43.490383 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37dc9c35-588b-4cbf-a530-c3215d2a73c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:43.683380 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d28d2de5-dc81-44f6-bfd3-3dbc5023452f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:43.684046 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d28d2de5-dc81-44f6-bfd3-3dbc5023452f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:43.690089 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d28d2de5-dc81-44f6-bfd3-3dbc5023452f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:43.690546 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d28d2de5-dc81-44f6-bfd3-3dbc5023452f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:43.691320 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d28d2de5-dc81-44f6-bfd3-3dbc5023452f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:43.691788 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d28d2de5-dc81-44f6-bfd3-3dbc5023452f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:43.723502 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-37dc9c35-588b-4cbf-a530-c3215d2a73c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:43.731381 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-37dc9c35-588b-4cbf-a530-c3215d2a73c9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1709 microversion: 2.1 time: 0.253826 Apr 11 13:58:43.732062 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 198/393] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:43 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1709 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:43.790121 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-de7b9df3-0783-4aa8-a69e-2b6580db8be4 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:43.790842 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-de7b9df3-0783-4aa8-a69e-2b6580db8be4 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:43.796680 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-de7b9df3-0783-4aa8-a69e-2b6580db8be4 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:43.797124 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-de7b9df3-0783-4aa8-a69e-2b6580db8be4 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:43.797885 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-de7b9df3-0783-4aa8-a69e-2b6580db8be4 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:43.798318 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-de7b9df3-0783-4aa8-a69e-2b6580db8be4 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:43.820651 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d28d2de5-dc81-44f6-bfd3-3dbc5023452f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:43.829476 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d28d2de5-dc81-44f6-bfd3-3dbc5023452f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:43.830969 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d28d2de5-dc81-44f6-bfd3-3dbc5023452f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:43.832205 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d28d2de5-dc81-44f6-bfd3-3dbc5023452f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.152689 Apr 11 13:58:43.832764 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 196/394] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:43 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:58:43.922805 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-de7b9df3-0783-4aa8-a69e-2b6580db8be4 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:43.930156 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-de7b9df3-0783-4aa8-a69e-2b6580db8be4 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1359 microversion: 2.1 time: 0.144087 Apr 11 13:58:43.930718 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 199/395] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:43 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:44.078586 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-901ad273-0bd1-4a29-ad79-f8447d5bebb0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:44.079130 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-901ad273-0bd1-4a29-ad79-f8447d5bebb0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:44.085012 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-901ad273-0bd1-4a29-ad79-f8447d5bebb0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:44.085470 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-901ad273-0bd1-4a29-ad79-f8447d5bebb0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:44.086240 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-901ad273-0bd1-4a29-ad79-f8447d5bebb0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:44.086682 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-901ad273-0bd1-4a29-ad79-f8447d5bebb0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:44.218267 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-901ad273-0bd1-4a29-ad79-f8447d5bebb0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:44.225536 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-901ad273-0bd1-4a29-ad79-f8447d5bebb0 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.151438 Apr 11 13:58:44.226125 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 197/396] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:44 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:44.302826 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-93049e54-dec5-4bb0-8d17-eba976273b80 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:44.303441 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-93049e54-dec5-4bb0-8d17-eba976273b80 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:44.309366 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-93049e54-dec5-4bb0-8d17-eba976273b80 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:44.309813 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-93049e54-dec5-4bb0-8d17-eba976273b80 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:44.310579 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-93049e54-dec5-4bb0-8d17-eba976273b80 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:44.311012 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-93049e54-dec5-4bb0-8d17-eba976273b80 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:44.390843 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-93049e54-dec5-4bb0-8d17-eba976273b80 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:44.410030 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-93049e54-dec5-4bb0-8d17-eba976273b80 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1130 microversion: 2.1 time: 0.107097 Apr 11 13:58:44.419279 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 200/397] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:44 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1130 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:44.749355 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-89fead24-8363-40cd-9e49-0b6f7c519fcf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:44.749976 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-89fead24-8363-40cd-9e49-0b6f7c519fcf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:44.756320 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89fead24-8363-40cd-9e49-0b6f7c519fcf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:44.756780 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89fead24-8363-40cd-9e49-0b6f7c519fcf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:44.757554 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89fead24-8363-40cd-9e49-0b6f7c519fcf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:44.757997 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89fead24-8363-40cd-9e49-0b6f7c519fcf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:44.850142 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-72b5c6a0-fe58-4ed3-abb8-fbdc21c605b4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:44.850754 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-72b5c6a0-fe58-4ed3-abb8-fbdc21c605b4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:44.856891 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-72b5c6a0-fe58-4ed3-abb8-fbdc21c605b4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:44.857347 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-72b5c6a0-fe58-4ed3-abb8-fbdc21c605b4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:44.859069 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-72b5c6a0-fe58-4ed3-abb8-fbdc21c605b4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:44.859588 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-72b5c6a0-fe58-4ed3-abb8-fbdc21c605b4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:44.882057 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-89fead24-8363-40cd-9e49-0b6f7c519fcf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:44.890648 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-89fead24-8363-40cd-9e49-0b6f7c519fcf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1709 microversion: 2.1 time: 0.145207 Apr 11 13:58:44.891269 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 198/398] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:44 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1709 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:44.947371 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-35bae716-2775-410c-ad7b-d859933eb7eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:44.948105 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-35bae716-2775-410c-ad7b-d859933eb7eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:44.954551 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35bae716-2775-410c-ad7b-d859933eb7eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:44.955085 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35bae716-2775-410c-ad7b-d859933eb7eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:44.956076 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35bae716-2775-410c-ad7b-d859933eb7eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:44.956589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35bae716-2775-410c-ad7b-d859933eb7eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:45.106912 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-35bae716-2775-410c-ad7b-d859933eb7eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:45.125781 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-35bae716-2775-410c-ad7b-d859933eb7eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1548 microversion: 2.1 time: 0.182025 Apr 11 13:58:45.131687 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 199/399] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:44 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1548 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:45.146507 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f2069d60-2101-4b59-b7c1-5a9b639cb155 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:45.147174 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f2069d60-2101-4b59-b7c1-5a9b639cb155 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:45.153544 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f2069d60-2101-4b59-b7c1-5a9b639cb155 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:45.154532 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f2069d60-2101-4b59-b7c1-5a9b639cb155 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:45.154842 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f2069d60-2101-4b59-b7c1-5a9b639cb155 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:45.155482 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f2069d60-2101-4b59-b7c1-5a9b639cb155 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:45.224250 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-72b5c6a0-fe58-4ed3-abb8-fbdc21c605b4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:45.232343 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-72b5c6a0-fe58-4ed3-abb8-fbdc21c605b4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:45.234751 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-72b5c6a0-fe58-4ed3-abb8-fbdc21c605b4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:45.236041 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-72b5c6a0-fe58-4ed3-abb8-fbdc21c605b4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.389609 Apr 11 13:58:45.236748 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 201/400] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:44 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:58:45.241995 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-82e6a105-107a-4244-b6e2-a75fc7c18e85 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:45.242808 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-82e6a105-107a-4244-b6e2-a75fc7c18e85 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:45.248800 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-82e6a105-107a-4244-b6e2-a75fc7c18e85 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:45.249552 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-82e6a105-107a-4244-b6e2-a75fc7c18e85 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:45.250333 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-82e6a105-107a-4244-b6e2-a75fc7c18e85 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:45.250766 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-82e6a105-107a-4244-b6e2-a75fc7c18e85 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:45.284321 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f2069d60-2101-4b59-b7c1-5a9b639cb155 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:45.292540 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f2069d60-2101-4b59-b7c1-5a9b639cb155 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1548 microversion: 2.1 time: 0.150462 Apr 11 13:58:45.293114 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 200/401] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:45 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:45.309339 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5f10a5cc-9c95-408c-86c0-2ca824f15a89 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:45.312811 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5f10a5cc-9c95-408c-86c0-2ca824f15a89 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:45.313589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5f10a5cc-9c95-408c-86c0-2ca824f15a89 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Searching by: {'deleted': False, 'project_id': '644547f80e2543079781f0c7b34c40b4'} {{(pid=116941) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 11 13:58:45.320044 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5f10a5cc-9c95-408c-86c0-2ca824f15a89 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:45.320498 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5f10a5cc-9c95-408c-86c0-2ca824f15a89 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:45.321312 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5f10a5cc-9c95-408c-86c0-2ca824f15a89 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:45.321755 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5f10a5cc-9c95-408c-86c0-2ca824f15a89 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:45.382754 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-82e6a105-107a-4244-b6e2-a75fc7c18e85 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:45.389807 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-82e6a105-107a-4244-b6e2-a75fc7c18e85 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.151621 Apr 11 13:58:45.390369 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 202/402] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:45 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:45.411834 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.multi_cell_list [None req-5f10a5cc-9c95-408c-86c0-2ca824f15a89 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 13:58:45.427595 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2efc6116-0e10-4b6d-97e8-03f9a94f9b8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:45.428228 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2efc6116-0e10-4b6d-97e8-03f9a94f9b8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:45.434065 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2efc6116-0e10-4b6d-97e8-03f9a94f9b8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:45.434513 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2efc6116-0e10-4b6d-97e8-03f9a94f9b8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:45.435272 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2efc6116-0e10-4b6d-97e8-03f9a94f9b8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:45.435728 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2efc6116-0e10-4b6d-97e8-03f9a94f9b8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:45.494545 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2efc6116-0e10-4b6d-97e8-03f9a94f9b8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:45.501998 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2efc6116-0e10-4b6d-97e8-03f9a94f9b8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1194 microversion: 2.1 time: 0.078147 Apr 11 13:58:45.502592 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 203/403] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:45 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:45.510114 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5f10a5cc-9c95-408c-86c0-2ca824f15a89 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204514 Apr 11 13:58:45.510692 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 201/404] 10.222.0.67 () {58 vars in 1124 bytes} [Mon Apr 11 13:58:45 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 13:58:45.520526 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a89f4f67-122c-4114-a3a2-7ce65258cead tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:45.521146 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a89f4f67-122c-4114-a3a2-7ce65258cead tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:45.526903 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a89f4f67-122c-4114-a3a2-7ce65258cead tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:45.527350 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a89f4f67-122c-4114-a3a2-7ce65258cead tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:45.528140 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a89f4f67-122c-4114-a3a2-7ce65258cead tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:45.528576 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a89f4f67-122c-4114-a3a2-7ce65258cead tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:45.653791 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a89f4f67-122c-4114-a3a2-7ce65258cead tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:45.661572 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a89f4f67-122c-4114-a3a2-7ce65258cead tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1548 microversion: 2.1 time: 0.144680 Apr 11 13:58:45.662135 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 204/405] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:45 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:45.909057 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-92b20eba-74de-4d8f-adf8-582ea64145ad tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:45.915347 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-92b20eba-74de-4d8f-adf8-582ea64145ad tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:45.925167 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92b20eba-74de-4d8f-adf8-582ea64145ad tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:45.925628 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92b20eba-74de-4d8f-adf8-582ea64145ad tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:45.926474 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92b20eba-74de-4d8f-adf8-582ea64145ad tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:45.926920 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92b20eba-74de-4d8f-adf8-582ea64145ad tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:46.066183 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-92b20eba-74de-4d8f-adf8-582ea64145ad tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:46.074699 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-92b20eba-74de-4d8f-adf8-582ea64145ad tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1713 microversion: 2.1 time: 0.170688 Apr 11 13:58:46.075714 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 202/406] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:45 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1713 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:46.254478 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a2f8bdc4-3ba6-4019-928a-dd2c308f1515 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:46.255078 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a2f8bdc4-3ba6-4019-928a-dd2c308f1515 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:46.261330 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a2f8bdc4-3ba6-4019-928a-dd2c308f1515 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:46.261765 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a2f8bdc4-3ba6-4019-928a-dd2c308f1515 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:46.262519 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a2f8bdc4-3ba6-4019-928a-dd2c308f1515 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:46.262943 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a2f8bdc4-3ba6-4019-928a-dd2c308f1515 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:46.395217 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a2f8bdc4-3ba6-4019-928a-dd2c308f1515 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:46.403739 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a2f8bdc4-3ba6-4019-928a-dd2c308f1515 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:46.405885 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a2f8bdc4-3ba6-4019-928a-dd2c308f1515 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:46.406620 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-478965e2-735c-4267-ad7d-0919ff55d865 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:46.407092 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a2f8bdc4-3ba6-4019-928a-dd2c308f1515 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.156443 Apr 11 13:58:46.407245 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-478965e2-735c-4267-ad7d-0919ff55d865 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:46.407663 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 205/407] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:46 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:46.412987 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-478965e2-735c-4267-ad7d-0919ff55d865 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:46.413441 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-478965e2-735c-4267-ad7d-0919ff55d865 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:46.414461 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-478965e2-735c-4267-ad7d-0919ff55d865 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:46.414896 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-478965e2-735c-4267-ad7d-0919ff55d865 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:46.519034 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ae11f06b-7381-4c7f-9a72-07a79cb502c4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:46.519420 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ae11f06b-7381-4c7f-9a72-07a79cb502c4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:46.525569 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae11f06b-7381-4c7f-9a72-07a79cb502c4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:46.526028 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae11f06b-7381-4c7f-9a72-07a79cb502c4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:46.526830 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae11f06b-7381-4c7f-9a72-07a79cb502c4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:46.527264 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae11f06b-7381-4c7f-9a72-07a79cb502c4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:46.541523 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-478965e2-735c-4267-ad7d-0919ff55d865 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:46.548974 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-478965e2-735c-4267-ad7d-0919ff55d865 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.146660 Apr 11 13:58:46.549558 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 203/408] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:46 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:46.595579 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ae11f06b-7381-4c7f-9a72-07a79cb502c4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:46.602962 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ae11f06b-7381-4c7f-9a72-07a79cb502c4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1194 microversion: 2.1 time: 0.088553 Apr 11 13:58:46.603777 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 206/409] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:46 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:46.692676 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b3b40191-3168-4fe0-8e05-a23aae733d8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bba0bb7d-357b-4178-9762-fbd709ee3cb7"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:46.693760 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b3b40191-3168-4fe0-8e05-a23aae733d8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:46.699750 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b3b40191-3168-4fe0-8e05-a23aae733d8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:46.700209 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b3b40191-3168-4fe0-8e05-a23aae733d8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:46.700988 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b3b40191-3168-4fe0-8e05-a23aae733d8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:46.701425 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b3b40191-3168-4fe0-8e05-a23aae733d8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:46.958251 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b3b40191-3168-4fe0-8e05-a23aae733d8c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "POST /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269494 Apr 11 13:58:46.958934 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 204/410] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 13:58:46 2022] POST /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:58:47.276379 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-29a7e8cf-f891-40b7-90e2-2128b18b1474 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20704b97-578c-4eac-a369-1ca0c46dc5f2"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:47.277452 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-29a7e8cf-f891-40b7-90e2-2128b18b1474 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:47.285126 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29a7e8cf-f891-40b7-90e2-2128b18b1474 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:47.285573 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29a7e8cf-f891-40b7-90e2-2128b18b1474 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:47.286583 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29a7e8cf-f891-40b7-90e2-2128b18b1474 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:47.287340 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29a7e8cf-f891-40b7-90e2-2128b18b1474 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:47.426713 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7753722e-66ce-45ff-ae3c-9b73aefd9906 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:47.427344 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7753722e-66ce-45ff-ae3c-9b73aefd9906 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:47.433514 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7753722e-66ce-45ff-ae3c-9b73aefd9906 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:47.433964 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7753722e-66ce-45ff-ae3c-9b73aefd9906 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:47.434787 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7753722e-66ce-45ff-ae3c-9b73aefd9906 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:47.435243 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7753722e-66ce-45ff-ae3c-9b73aefd9906 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:47.562704 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7753722e-66ce-45ff-ae3c-9b73aefd9906 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:47.571017 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7753722e-66ce-45ff-ae3c-9b73aefd9906 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:47.572659 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7753722e-66ce-45ff-ae3c-9b73aefd9906 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:47.573867 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7753722e-66ce-45ff-ae3c-9b73aefd9906 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.151917 Apr 11 13:58:47.574429 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 205/411] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:47 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 13:58:47.579396 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3fea6b7e-6879-46ad-ac68-3a577fae7ab7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:47.580032 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3fea6b7e-6879-46ad-ac68-3a577fae7ab7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:47.585607 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fea6b7e-6879-46ad-ac68-3a577fae7ab7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:47.586351 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fea6b7e-6879-46ad-ac68-3a577fae7ab7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:47.586885 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fea6b7e-6879-46ad-ac68-3a577fae7ab7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:47.587369 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fea6b7e-6879-46ad-ac68-3a577fae7ab7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:47.718979 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3fea6b7e-6879-46ad-ac68-3a577fae7ab7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:47.726697 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3fea6b7e-6879-46ad-ac68-3a577fae7ab7 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.151234 Apr 11 13:58:47.727294 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 206/412] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:47 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:47.731740 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-671f7f81-02a3-4a6e-af9d-1d066375eec1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:47.732518 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-671f7f81-02a3-4a6e-af9d-1d066375eec1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:47.738833 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-671f7f81-02a3-4a6e-af9d-1d066375eec1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:47.739281 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-671f7f81-02a3-4a6e-af9d-1d066375eec1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:47.740091 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-671f7f81-02a3-4a6e-af9d-1d066375eec1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:47.740530 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-671f7f81-02a3-4a6e-af9d-1d066375eec1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:47.874894 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-671f7f81-02a3-4a6e-af9d-1d066375eec1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:47.882105 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-671f7f81-02a3-4a6e-af9d-1d066375eec1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1272 microversion: 2.1 time: 0.153838 Apr 11 13:58:47.882668 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 207/413] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:47 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:48.290639 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-29a7e8cf-f891-40b7-90e2-2128b18b1474 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "POST /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.018203 Apr 11 13:58:48.291249 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 207/414] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 13:58:47 2022] POST /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/os-volume_attachments => generated 194 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:58:48.592933 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8dc02bc1-9a54-4bb7-a709-4cf2d12871d4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:48.593653 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8dc02bc1-9a54-4bb7-a709-4cf2d12871d4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:48.605645 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8dc02bc1-9a54-4bb7-a709-4cf2d12871d4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:48.606756 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8dc02bc1-9a54-4bb7-a709-4cf2d12871d4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:48.608384 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8dc02bc1-9a54-4bb7-a709-4cf2d12871d4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:48.609318 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8dc02bc1-9a54-4bb7-a709-4cf2d12871d4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:48.747273 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-620ed63e-7d0d-4cfc-890c-8e6a0ed8d4cf tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:48.749076 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-620ed63e-7d0d-4cfc-890c-8e6a0ed8d4cf tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:48.757684 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-620ed63e-7d0d-4cfc-890c-8e6a0ed8d4cf tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:48.758446 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-620ed63e-7d0d-4cfc-890c-8e6a0ed8d4cf tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:48.759525 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-620ed63e-7d0d-4cfc-890c-8e6a0ed8d4cf tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:48.760240 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-620ed63e-7d0d-4cfc-890c-8e6a0ed8d4cf tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:48.813322 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8dc02bc1-9a54-4bb7-a709-4cf2d12871d4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:48.823589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8dc02bc1-9a54-4bb7-a709-4cf2d12871d4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:48.825678 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8dc02bc1-9a54-4bb7-a709-4cf2d12871d4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:48.827899 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8dc02bc1-9a54-4bb7-a709-4cf2d12871d4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.239316 Apr 11 13:58:48.829201 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 208/415] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:48 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:48.834391 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-b115e5f9-3c89-4ee8-874b-cdd57d2dcd86 req-a6f58650-357f-40b2-ad37-4040839d0cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a988bf-9fbe-4371-a34f-2437494ec1ee", "tag": "2f18b7d6-84d7-4249-8b95-51fdbd414e68"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:48.844581 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-b115e5f9-3c89-4ee8-874b-cdd57d2dcd86 req-a6f58650-357f-40b2-ad37-4040839d0cc6 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:48.845421 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-b115e5f9-3c89-4ee8-874b-cdd57d2dcd86 req-a6f58650-357f-40b2-ad37-4040839d0cc6 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:48.858413 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-b115e5f9-3c89-4ee8-874b-cdd57d2dcd86 req-a6f58650-357f-40b2-ad37-4040839d0cc6 service nova] Creating event network-changed:2f18b7d6-84d7-4249-8b95-51fdbd414e68 for instance e2a988bf-9fbe-4371-a34f-2437494ec1ee on hv-cinder-83078 Apr 11 13:58:48.865335 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-b115e5f9-3c89-4ee8-874b-cdd57d2dcd86 req-a6f58650-357f-40b2-ad37-4040839d0cc6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034337 Apr 11 13:58:48.865962 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 209/416] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:58:48.902859 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-88e45e8b-18c8-4ede-b932-1afb9e2e9cdd tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:48.903665 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-88e45e8b-18c8-4ede-b932-1afb9e2e9cdd tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:48.920143 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-88e45e8b-18c8-4ede-b932-1afb9e2e9cdd tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:48.920884 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-88e45e8b-18c8-4ede-b932-1afb9e2e9cdd tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:48.921855 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-88e45e8b-18c8-4ede-b932-1afb9e2e9cdd tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:48.922491 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-88e45e8b-18c8-4ede-b932-1afb9e2e9cdd tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:49.018830 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-620ed63e-7d0d-4cfc-890c-8e6a0ed8d4cf tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:49.026720 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-620ed63e-7d0d-4cfc-890c-8e6a0ed8d4cf tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.286519 Apr 11 13:58:49.027291 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 208/417] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:48 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:49.062516 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-88e45e8b-18c8-4ede-b932-1afb9e2e9cdd tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:49.069878 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-88e45e8b-18c8-4ede-b932-1afb9e2e9cdd tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1260 microversion: 2.1 time: 0.173948 Apr 11 13:58:49.070446 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 210/418] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:48 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:49.846987 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a77e9322-0055-4055-bc39-29b5066eacb5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:49.847600 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a77e9322-0055-4055-bc39-29b5066eacb5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:49.853785 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a77e9322-0055-4055-bc39-29b5066eacb5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:49.854227 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a77e9322-0055-4055-bc39-29b5066eacb5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:49.854985 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a77e9322-0055-4055-bc39-29b5066eacb5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:49.855415 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a77e9322-0055-4055-bc39-29b5066eacb5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:50.044648 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-02a83880-fa75-4562-a396-780c66b935d5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:50.045944 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-02a83880-fa75-4562-a396-780c66b935d5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:50.052394 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02a83880-fa75-4562-a396-780c66b935d5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:50.052918 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02a83880-fa75-4562-a396-780c66b935d5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:50.053624 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02a83880-fa75-4562-a396-780c66b935d5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:50.054069 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02a83880-fa75-4562-a396-780c66b935d5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:50.056030 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a77e9322-0055-4055-bc39-29b5066eacb5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:50.064571 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a77e9322-0055-4055-bc39-29b5066eacb5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:50.066228 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a77e9322-0055-4055-bc39-29b5066eacb5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:50.067560 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a77e9322-0055-4055-bc39-29b5066eacb5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.224398 Apr 11 13:58:50.068243 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 209/419] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:49 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:50.089326 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4937e6ca-cef8-4424-86db-52573e46ce7e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:50.089921 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4937e6ca-cef8-4424-86db-52573e46ce7e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:50.096361 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4937e6ca-cef8-4424-86db-52573e46ce7e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:50.096810 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4937e6ca-cef8-4424-86db-52573e46ce7e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:50.097588 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4937e6ca-cef8-4424-86db-52573e46ce7e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:50.098025 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4937e6ca-cef8-4424-86db-52573e46ce7e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:50.193563 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-02a83880-fa75-4562-a396-780c66b935d5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:50.200846 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-02a83880-fa75-4562-a396-780c66b935d5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.160052 Apr 11 13:58:50.201976 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 211/420] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:50 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:50.238492 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4937e6ca-cef8-4424-86db-52573e46ce7e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:50.245659 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4937e6ca-cef8-4424-86db-52573e46ce7e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1260 microversion: 2.1 time: 0.160112 Apr 11 13:58:50.246215 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 210/421] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:50 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:50.882489 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-745cb126-f253-4931-9a83-9e80af43ed66 req-0ecabd3a-3e73-43b5-a44e-f357e71fa5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94420324-3720-447d-b195-df28fb7d8fc7", "name": "network-vif-plugged", "status": "completed", "tag": "ff4c3178-c740-4cea-87a2-4bed198b02e0"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:50.890529 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-745cb126-f253-4931-9a83-9e80af43ed66 req-0ecabd3a-3e73-43b5-a44e-f357e71fa5d2 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:50.890982 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-745cb126-f253-4931-9a83-9e80af43ed66 req-0ecabd3a-3e73-43b5-a44e-f357e71fa5d2 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:50.902603 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-745cb126-f253-4931-9a83-9e80af43ed66 req-0ecabd3a-3e73-43b5-a44e-f357e71fa5d2 service nova] Creating event network-vif-plugged:ff4c3178-c740-4cea-87a2-4bed198b02e0 for instance 94420324-3720-447d-b195-df28fb7d8fc7 on hv-cinder-83078 Apr 11 13:58:50.907433 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-745cb126-f253-4931-9a83-9e80af43ed66 req-0ecabd3a-3e73-43b5-a44e-f357e71fa5d2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028691 Apr 11 13:58:50.908085 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 212/422] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:58:51.086160 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9e48795c-b1f6-4fe6-a411-3882fc23b2fa tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:51.086924 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9e48795c-b1f6-4fe6-a411-3882fc23b2fa tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:51.095016 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e48795c-b1f6-4fe6-a411-3882fc23b2fa tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:51.095462 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e48795c-b1f6-4fe6-a411-3882fc23b2fa tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:51.096266 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e48795c-b1f6-4fe6-a411-3882fc23b2fa tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:51.096700 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e48795c-b1f6-4fe6-a411-3882fc23b2fa tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:51.219592 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a761d560-3a55-4359-b852-9dfed3cfe657 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:51.220491 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a761d560-3a55-4359-b852-9dfed3cfe657 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:51.227078 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a761d560-3a55-4359-b852-9dfed3cfe657 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:51.227532 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a761d560-3a55-4359-b852-9dfed3cfe657 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:51.236926 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a761d560-3a55-4359-b852-9dfed3cfe657 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:51.236926 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a761d560-3a55-4359-b852-9dfed3cfe657 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:51.244978 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9e48795c-b1f6-4fe6-a411-3882fc23b2fa tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:51.254181 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9e48795c-b1f6-4fe6-a411-3882fc23b2fa tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:51.258102 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9e48795c-b1f6-4fe6-a411-3882fc23b2fa tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:51.259536 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9e48795c-b1f6-4fe6-a411-3882fc23b2fa tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.177346 Apr 11 13:58:51.260326 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 211/423] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:51 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:51.265964 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-40b11b85-c808-40e7-b39b-fa54f73c9ecc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:51.266580 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-40b11b85-c808-40e7-b39b-fa54f73c9ecc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:51.272851 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40b11b85-c808-40e7-b39b-fa54f73c9ecc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:51.273915 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40b11b85-c808-40e7-b39b-fa54f73c9ecc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:51.274711 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40b11b85-c808-40e7-b39b-fa54f73c9ecc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:51.275313 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40b11b85-c808-40e7-b39b-fa54f73c9ecc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:51.375159 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a761d560-3a55-4359-b852-9dfed3cfe657 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:51.387066 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a761d560-3a55-4359-b852-9dfed3cfe657 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.172431 Apr 11 13:58:51.387841 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 213/424] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:51 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:51.426279 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-40b11b85-c808-40e7-b39b-fa54f73c9ecc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:51.433475 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-40b11b85-c808-40e7-b39b-fa54f73c9ecc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1260 microversion: 2.1 time: 0.172025 Apr 11 13:58:51.434040 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 212/425] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:51 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:52.278075 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0ba6e2f2-4b28-4c52-9d42-9a8dd8453794 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:52.278781 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0ba6e2f2-4b28-4c52-9d42-9a8dd8453794 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:52.285742 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ba6e2f2-4b28-4c52-9d42-9a8dd8453794 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:52.286192 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ba6e2f2-4b28-4c52-9d42-9a8dd8453794 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:52.286957 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ba6e2f2-4b28-4c52-9d42-9a8dd8453794 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:52.287388 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ba6e2f2-4b28-4c52-9d42-9a8dd8453794 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:52.404052 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ba1b2c34-2501-4db8-bf6d-2a852126d696 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:52.405322 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ba1b2c34-2501-4db8-bf6d-2a852126d696 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:52.411860 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba1b2c34-2501-4db8-bf6d-2a852126d696 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:52.412321 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba1b2c34-2501-4db8-bf6d-2a852126d696 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:52.413355 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba1b2c34-2501-4db8-bf6d-2a852126d696 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:52.413795 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba1b2c34-2501-4db8-bf6d-2a852126d696 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:52.415548 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0ba6e2f2-4b28-4c52-9d42-9a8dd8453794 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:52.423897 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0ba6e2f2-4b28-4c52-9d42-9a8dd8453794 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:52.425408 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0ba6e2f2-4b28-4c52-9d42-9a8dd8453794 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:52.426566 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0ba6e2f2-4b28-4c52-9d42-9a8dd8453794 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.152296 Apr 11 13:58:52.427121 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 214/426] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:52 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:52.449973 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-acaabdbb-7d2b-45f2-9676-59cc094a152d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:52.450601 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-acaabdbb-7d2b-45f2-9676-59cc094a152d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:52.457009 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-acaabdbb-7d2b-45f2-9676-59cc094a152d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:52.457467 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-acaabdbb-7d2b-45f2-9676-59cc094a152d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:52.458306 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-acaabdbb-7d2b-45f2-9676-59cc094a152d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:52.458749 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-acaabdbb-7d2b-45f2-9676-59cc094a152d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:52.542586 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ba1b2c34-2501-4db8-bf6d-2a852126d696 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:52.550480 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ba1b2c34-2501-4db8-bf6d-2a852126d696 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1319 microversion: 2.1 time: 0.150179 Apr 11 13:58:52.551062 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 213/427] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:52 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:52.595891 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-acaabdbb-7d2b-45f2-9676-59cc094a152d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:52.602851 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-acaabdbb-7d2b-45f2-9676-59cc094a152d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1260 microversion: 2.1 time: 0.156621 Apr 11 13:58:52.603432 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 215/428] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:52 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:52.940129 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-8d8cd98d-b773-47ca-9a6d-93b7fbf2d358 req-c0a12418-6287-46e7-824a-ab97bccab018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5f3b7d-8b92-4264-b41a-1d1ade879f2f", "name": "network-vif-plugged", "status": "completed", "tag": "cda04f4a-80ef-4c18-b575-cb87293272ce"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:52.948162 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-8d8cd98d-b773-47ca-9a6d-93b7fbf2d358 req-c0a12418-6287-46e7-824a-ab97bccab018 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:52.948602 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-8d8cd98d-b773-47ca-9a6d-93b7fbf2d358 req-c0a12418-6287-46e7-824a-ab97bccab018 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:52.960325 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-8d8cd98d-b773-47ca-9a6d-93b7fbf2d358 req-c0a12418-6287-46e7-824a-ab97bccab018 service nova] Creating event network-vif-plugged:cda04f4a-80ef-4c18-b575-cb87293272ce for instance 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f on hv-cinder-83078 Apr 11 13:58:52.965223 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-8d8cd98d-b773-47ca-9a6d-93b7fbf2d358 req-c0a12418-6287-46e7-824a-ab97bccab018 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029281 Apr 11 13:58:52.966035 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 214/429] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:58:53.444842 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a117065f-f28d-4557-8388-0f97a9836b75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:53.446205 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a117065f-f28d-4557-8388-0f97a9836b75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:53.453713 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a117065f-f28d-4557-8388-0f97a9836b75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:53.454211 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a117065f-f28d-4557-8388-0f97a9836b75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:53.454984 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a117065f-f28d-4557-8388-0f97a9836b75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:53.455417 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a117065f-f28d-4557-8388-0f97a9836b75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:53.571393 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ffc23759-93ae-4fd7-bae5-12346f0ff2e9 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:53.572132 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ffc23759-93ae-4fd7-bae5-12346f0ff2e9 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:53.580368 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffc23759-93ae-4fd7-bae5-12346f0ff2e9 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:53.580845 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffc23759-93ae-4fd7-bae5-12346f0ff2e9 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:53.581620 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffc23759-93ae-4fd7-bae5-12346f0ff2e9 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:53.582052 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffc23759-93ae-4fd7-bae5-12346f0ff2e9 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:53.586010 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a117065f-f28d-4557-8388-0f97a9836b75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:53.595541 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a117065f-f28d-4557-8388-0f97a9836b75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:53.597813 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a117065f-f28d-4557-8388-0f97a9836b75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:53.599052 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a117065f-f28d-4557-8388-0f97a9836b75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.158410 Apr 11 13:58:53.599648 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 216/430] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:53 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:53.619188 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-38d921a6-45d2-41e5-9bc4-6b1d4764c9c5 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:53.619871 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-38d921a6-45d2-41e5-9bc4-6b1d4764c9c5 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:53.625793 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38d921a6-45d2-41e5-9bc4-6b1d4764c9c5 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:53.626242 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38d921a6-45d2-41e5-9bc4-6b1d4764c9c5 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:53.627091 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38d921a6-45d2-41e5-9bc4-6b1d4764c9c5 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:53.627533 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38d921a6-45d2-41e5-9bc4-6b1d4764c9c5 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:53.710772 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ffc23759-93ae-4fd7-bae5-12346f0ff2e9 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:53.718575 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ffc23759-93ae-4fd7-bae5-12346f0ff2e9 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1507 microversion: 2.1 time: 0.153264 Apr 11 13:58:53.719155 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 215/431] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:53 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:53.759859 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-38d921a6-45d2-41e5-9bc4-6b1d4764c9c5 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:53.767682 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-38d921a6-45d2-41e5-9bc4-6b1d4764c9c5 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1260 microversion: 2.1 time: 0.152086 Apr 11 13:58:53.768286 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 217/432] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:53 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:54.618336 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-35b5cae2-5277-4dc6-958a-5713d9c81d4e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:54.619239 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-35b5cae2-5277-4dc6-958a-5713d9c81d4e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:54.625704 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35b5cae2-5277-4dc6-958a-5713d9c81d4e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:54.626161 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35b5cae2-5277-4dc6-958a-5713d9c81d4e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:54.626942 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35b5cae2-5277-4dc6-958a-5713d9c81d4e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:54.627377 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35b5cae2-5277-4dc6-958a-5713d9c81d4e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:54.760338 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-35b5cae2-5277-4dc6-958a-5713d9c81d4e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:54.771008 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-35b5cae2-5277-4dc6-958a-5713d9c81d4e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:54.772545 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-35b5cae2-5277-4dc6-958a-5713d9c81d4e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:54.773705 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-35b5cae2-5277-4dc6-958a-5713d9c81d4e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.159568 Apr 11 13:58:54.774266 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 216/433] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:54 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:54.784579 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7a09a7f8-a9fe-4c0c-8d12-c44cae1f8015 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:54.785194 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7a09a7f8-a9fe-4c0c-8d12-c44cae1f8015 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:54.791956 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7a09a7f8-a9fe-4c0c-8d12-c44cae1f8015 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:54.792502 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7a09a7f8-a9fe-4c0c-8d12-c44cae1f8015 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:54.793345 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7a09a7f8-a9fe-4c0c-8d12-c44cae1f8015 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:54.793788 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7a09a7f8-a9fe-4c0c-8d12-c44cae1f8015 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:54.927229 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7a09a7f8-a9fe-4c0c-8d12-c44cae1f8015 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:54.934470 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7a09a7f8-a9fe-4c0c-8d12-c44cae1f8015 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1260 microversion: 2.1 time: 0.153664 Apr 11 13:58:54.935026 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 218/434] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:54 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:55.793310 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8d98dabc-d614-4b9a-a355-a7e9ccef53f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:55.793919 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8d98dabc-d614-4b9a-a355-a7e9ccef53f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:55.800886 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8d98dabc-d614-4b9a-a355-a7e9ccef53f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:55.801332 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8d98dabc-d614-4b9a-a355-a7e9ccef53f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:55.802094 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8d98dabc-d614-4b9a-a355-a7e9ccef53f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:55.802527 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8d98dabc-d614-4b9a-a355-a7e9ccef53f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:55.931564 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8d98dabc-d614-4b9a-a355-a7e9ccef53f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:55.940207 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8d98dabc-d614-4b9a-a355-a7e9ccef53f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:55.941708 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8d98dabc-d614-4b9a-a355-a7e9ccef53f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:55.942856 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8d98dabc-d614-4b9a-a355-a7e9ccef53f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.153453 Apr 11 13:58:55.943417 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 217/435] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:55 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:55.949971 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3ed4b3fc-f687-41aa-95ad-cd4df05ac97b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:55.950582 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3ed4b3fc-f687-41aa-95ad-cd4df05ac97b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:55.957709 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3ed4b3fc-f687-41aa-95ad-cd4df05ac97b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:55.958151 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3ed4b3fc-f687-41aa-95ad-cd4df05ac97b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:55.958907 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3ed4b3fc-f687-41aa-95ad-cd4df05ac97b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:55.959336 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3ed4b3fc-f687-41aa-95ad-cd4df05ac97b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:56.088418 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3ed4b3fc-f687-41aa-95ad-cd4df05ac97b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:56.095650 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3ed4b3fc-f687-41aa-95ad-cd4df05ac97b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1260 microversion: 2.1 time: 0.149422 Apr 11 13:58:56.096239 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 219/436] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:55 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:56.961918 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b41a369d-d958-48f2-95b2-64cedb7089ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:56.962553 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b41a369d-d958-48f2-95b2-64cedb7089ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:56.971113 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b41a369d-d958-48f2-95b2-64cedb7089ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:56.971567 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b41a369d-d958-48f2-95b2-64cedb7089ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:56.972734 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b41a369d-d958-48f2-95b2-64cedb7089ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:56.973361 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b41a369d-d958-48f2-95b2-64cedb7089ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:57.103869 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b41a369d-d958-48f2-95b2-64cedb7089ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:57.112195 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3a6fa99a-4abd-4ea8-a745-326047d79a4e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:57.112743 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b41a369d-d958-48f2-95b2-64cedb7089ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:57.112845 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3a6fa99a-4abd-4ea8-a745-326047d79a4e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:57.116418 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b41a369d-d958-48f2-95b2-64cedb7089ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:57.117605 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b41a369d-d958-48f2-95b2-64cedb7089ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1808 microversion: 2.20 time: 0.159720 Apr 11 13:58:57.118170 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 218/437] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:56 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:57.119466 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a6fa99a-4abd-4ea8-a745-326047d79a4e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:57.119961 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a6fa99a-4abd-4ea8-a745-326047d79a4e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:57.120740 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a6fa99a-4abd-4ea8-a745-326047d79a4e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:57.121184 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a6fa99a-4abd-4ea8-a745-326047d79a4e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:57.274980 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3a6fa99a-4abd-4ea8-a745-326047d79a4e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:57.282788 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3a6fa99a-4abd-4ea8-a745-326047d79a4e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1260 microversion: 2.1 time: 0.174298 Apr 11 13:58:57.283369 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 220/438] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:57 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:57.616748 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-37cc2308-11c5-4579-bc71-cbe655f814a2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:58:57.617741 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-37cc2308-11c5-4579-bc71-cbe655f814a2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:57.624395 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37cc2308-11c5-4579-bc71-cbe655f814a2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:57.624904 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37cc2308-11c5-4579-bc71-cbe655f814a2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:57.625672 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37cc2308-11c5-4579-bc71-cbe655f814a2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:57.626111 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37cc2308-11c5-4579-bc71-cbe655f814a2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:57.646964 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-37cc2308-11c5-4579-bc71-cbe655f814a2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lazy-loading 'flavor' on Instance uuid a1b122bc-5193-4642-9f21-0e30c573c88e {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 13:58:57.770789 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-37cc2308-11c5-4579-bc71-cbe655f814a2 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "POST /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/action" status: 200 len: 32 microversion: 2.1 time: 0.157888 Apr 11 13:58:57.771394 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 219/439] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 13:58:57 2022] POST /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 13:58:57.781330 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c9433c88-453b-4889-8487-c6996bfa887d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:57.781943 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c9433c88-453b-4889-8487-c6996bfa887d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:57.788457 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9433c88-453b-4889-8487-c6996bfa887d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:57.788955 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9433c88-453b-4889-8487-c6996bfa887d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:57.789901 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9433c88-453b-4889-8487-c6996bfa887d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:57.790335 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9433c88-453b-4889-8487-c6996bfa887d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:57.923926 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c9433c88-453b-4889-8487-c6996bfa887d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:57.933055 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c9433c88-453b-4889-8487-c6996bfa887d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.156449 Apr 11 13:58:57.933648 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 221/440] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:57 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:58.137132 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-47cd4f10-d5fe-4b6c-bf30-f6d6a91ee2f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:58.137797 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-47cd4f10-d5fe-4b6c-bf30-f6d6a91ee2f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:58.144698 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-47cd4f10-d5fe-4b6c-bf30-f6d6a91ee2f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:58.145149 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-47cd4f10-d5fe-4b6c-bf30-f6d6a91ee2f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:58.145953 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-47cd4f10-d5fe-4b6c-bf30-f6d6a91ee2f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:58.146431 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-47cd4f10-d5fe-4b6c-bf30-f6d6a91ee2f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:58.300446 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-98aa7cde-c38f-4e54-acf5-ad90b0fed27b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:58.302013 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-98aa7cde-c38f-4e54-acf5-ad90b0fed27b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:58.317875 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98aa7cde-c38f-4e54-acf5-ad90b0fed27b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:58.318322 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98aa7cde-c38f-4e54-acf5-ad90b0fed27b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:58.319102 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98aa7cde-c38f-4e54-acf5-ad90b0fed27b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:58.319530 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98aa7cde-c38f-4e54-acf5-ad90b0fed27b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:58.589893 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-47cd4f10-d5fe-4b6c-bf30-f6d6a91ee2f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:58.602329 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-47cd4f10-d5fe-4b6c-bf30-f6d6a91ee2f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:58.604220 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-47cd4f10-d5fe-4b6c-bf30-f6d6a91ee2f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:58.605510 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-47cd4f10-d5fe-4b6c-bf30-f6d6a91ee2f8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1795 microversion: 2.20 time: 0.473115 Apr 11 13:58:58.606199 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 220/441] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 13:58:58 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1795 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 13:58:58.663527 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-98aa7cde-c38f-4e54-acf5-ad90b0fed27b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:58.678583 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-98aa7cde-c38f-4e54-acf5-ad90b0fed27b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1260 microversion: 2.1 time: 0.381866 Apr 11 13:58:58.679252 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 222/442] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:58 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1260 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:58:58.951429 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6e793b51-ac37-442f-b9e8-bb0ab1d415da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:58.952908 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6e793b51-ac37-442f-b9e8-bb0ab1d415da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:58.959862 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e793b51-ac37-442f-b9e8-bb0ab1d415da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:58.960309 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e793b51-ac37-442f-b9e8-bb0ab1d415da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:58.961089 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e793b51-ac37-442f-b9e8-bb0ab1d415da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:58.961521 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e793b51-ac37-442f-b9e8-bb0ab1d415da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:59.087929 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6e793b51-ac37-442f-b9e8-bb0ab1d415da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:59.096151 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6e793b51-ac37-442f-b9e8-bb0ab1d415da tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.149105 Apr 11 13:58:59.096724 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 221/443] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:58 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:58:59.696447 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3cf4cb5d-b772-486e-a433-cd625f8ab222 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:58:59.697096 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3cf4cb5d-b772-486e-a433-cd625f8ab222 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:58:59.703305 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3cf4cb5d-b772-486e-a433-cd625f8ab222 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:59.703817 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3cf4cb5d-b772-486e-a433-cd625f8ab222 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:59.704587 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3cf4cb5d-b772-486e-a433-cd625f8ab222 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:58:59.705023 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3cf4cb5d-b772-486e-a433-cd625f8ab222 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:58:59.834166 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3cf4cb5d-b772-486e-a433-cd625f8ab222 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:58:59.841912 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3cf4cb5d-b772-486e-a433-cd625f8ab222 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1260 microversion: 2.1 time: 0.149229 Apr 11 13:58:59.842571 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 223/444] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:58:59 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:00.113828 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f6e029d3-8a4b-48d2-80e2-6a1fd48f4030 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:00.114354 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f6e029d3-8a4b-48d2-80e2-6a1fd48f4030 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:00.120613 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6e029d3-8a4b-48d2-80e2-6a1fd48f4030 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:00.121060 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6e029d3-8a4b-48d2-80e2-6a1fd48f4030 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:00.121818 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6e029d3-8a4b-48d2-80e2-6a1fd48f4030 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:00.122342 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f6e029d3-8a4b-48d2-80e2-6a1fd48f4030 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:00.254684 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f6e029d3-8a4b-48d2-80e2-6a1fd48f4030 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:00.262388 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f6e029d3-8a4b-48d2-80e2-6a1fd48f4030 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.152436 Apr 11 13:59:00.262955 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 222/445] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:00 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:00.823802 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-934b4b93-c4a7-4987-8b82-f941d612d7cd req-aca47321-d8f6-4db9-9ffb-45d79892be6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a988bf-9fbe-4371-a34f-2437494ec1ee", "name": "network-vif-plugged", "status": "completed", "tag": "2f18b7d6-84d7-4249-8b95-51fdbd414e68"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:00.832807 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-934b4b93-c4a7-4987-8b82-f941d612d7cd req-aca47321-d8f6-4db9-9ffb-45d79892be6c service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:00.833264 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-934b4b93-c4a7-4987-8b82-f941d612d7cd req-aca47321-d8f6-4db9-9ffb-45d79892be6c service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:00.850860 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-934b4b93-c4a7-4987-8b82-f941d612d7cd req-aca47321-d8f6-4db9-9ffb-45d79892be6c service nova] Creating event network-vif-plugged:2f18b7d6-84d7-4249-8b95-51fdbd414e68 for instance e2a988bf-9fbe-4371-a34f-2437494ec1ee on hv-cinder-83078 Apr 11 13:59:00.856043 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-934b4b93-c4a7-4987-8b82-f941d612d7cd req-aca47321-d8f6-4db9-9ffb-45d79892be6c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035925 Apr 11 13:59:00.856911 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 224/446] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:59:00.860534 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-78892c9c-72bf-4ffb-98f4-ea4c5387ae8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:00.861157 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-78892c9c-72bf-4ffb-98f4-ea4c5387ae8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:00.867130 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78892c9c-72bf-4ffb-98f4-ea4c5387ae8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:00.867514 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78892c9c-72bf-4ffb-98f4-ea4c5387ae8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:00.868321 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78892c9c-72bf-4ffb-98f4-ea4c5387ae8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:00.868775 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78892c9c-72bf-4ffb-98f4-ea4c5387ae8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:01.000609 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-78892c9c-72bf-4ffb-98f4-ea4c5387ae8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:01.007864 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-78892c9c-72bf-4ffb-98f4-ea4c5387ae8b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1260 microversion: 2.1 time: 0.152755 Apr 11 13:59:01.008429 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 223/447] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:00 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:01.280080 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2cd256b6-798d-47d8-87a0-70bccfe768c6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:01.280704 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2cd256b6-798d-47d8-87a0-70bccfe768c6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:01.286842 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2cd256b6-798d-47d8-87a0-70bccfe768c6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:01.287302 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2cd256b6-798d-47d8-87a0-70bccfe768c6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:01.288359 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2cd256b6-798d-47d8-87a0-70bccfe768c6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:01.288853 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2cd256b6-798d-47d8-87a0-70bccfe768c6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:01.421382 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2cd256b6-798d-47d8-87a0-70bccfe768c6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:01.429358 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2cd256b6-798d-47d8-87a0-70bccfe768c6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.153527 Apr 11 13:59:01.430001 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 225/448] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:01 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:02.024228 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4939e27a-cc39-432b-b8cc-0b8ba48b1177 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:02.024837 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4939e27a-cc39-432b-b8cc-0b8ba48b1177 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:02.032084 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4939e27a-cc39-432b-b8cc-0b8ba48b1177 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:02.032534 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4939e27a-cc39-432b-b8cc-0b8ba48b1177 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:02.033299 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4939e27a-cc39-432b-b8cc-0b8ba48b1177 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:02.033729 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4939e27a-cc39-432b-b8cc-0b8ba48b1177 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:02.169446 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4939e27a-cc39-432b-b8cc-0b8ba48b1177 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:02.177425 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4939e27a-cc39-432b-b8cc-0b8ba48b1177 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1260 microversion: 2.1 time: 0.156897 Apr 11 13:59:02.177995 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 224/449] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:02 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:02.448032 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0fc0f6f6-9f93-4e46-8d42-fe69dedb0afd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:02.448654 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0fc0f6f6-9f93-4e46-8d42-fe69dedb0afd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:02.455734 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0fc0f6f6-9f93-4e46-8d42-fe69dedb0afd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:02.456187 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0fc0f6f6-9f93-4e46-8d42-fe69dedb0afd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:02.456968 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0fc0f6f6-9f93-4e46-8d42-fe69dedb0afd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:02.457401 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0fc0f6f6-9f93-4e46-8d42-fe69dedb0afd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:02.585552 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0fc0f6f6-9f93-4e46-8d42-fe69dedb0afd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:02.593334 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0fc0f6f6-9f93-4e46-8d42-fe69dedb0afd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.149200 Apr 11 13:59:02.593894 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 226/450] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:02 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:03.195417 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8acaed32-a103-4216-b85c-effeb7e83ce6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:03.196058 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8acaed32-a103-4216-b85c-effeb7e83ce6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:03.202344 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8acaed32-a103-4216-b85c-effeb7e83ce6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:03.202791 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8acaed32-a103-4216-b85c-effeb7e83ce6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:03.203545 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8acaed32-a103-4216-b85c-effeb7e83ce6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:03.204019 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8acaed32-a103-4216-b85c-effeb7e83ce6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:03.334850 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8acaed32-a103-4216-b85c-effeb7e83ce6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:03.343308 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8acaed32-a103-4216-b85c-effeb7e83ce6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1443 microversion: 2.1 time: 0.151689 Apr 11 13:59:03.343926 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 225/451] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:03 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:03.360326 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9174b416-0d81-4795-94c3-0ea2635f48a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:03.360945 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9174b416-0d81-4795-94c3-0ea2635f48a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:03.367248 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9174b416-0d81-4795-94c3-0ea2635f48a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:03.367723 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9174b416-0d81-4795-94c3-0ea2635f48a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:03.368486 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9174b416-0d81-4795-94c3-0ea2635f48a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:03.368920 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9174b416-0d81-4795-94c3-0ea2635f48a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:03.502331 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9174b416-0d81-4795-94c3-0ea2635f48a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:03.509615 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9174b416-0d81-4795-94c3-0ea2635f48a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1443 microversion: 2.1 time: 0.153819 Apr 11 13:59:03.510188 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 227/452] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:03 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:03.609584 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ca8504b0-18e8-4c91-97b1-b054a34d5d61 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:03.610197 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ca8504b0-18e8-4c91-97b1-b054a34d5d61 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:03.616082 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca8504b0-18e8-4c91-97b1-b054a34d5d61 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:03.616534 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca8504b0-18e8-4c91-97b1-b054a34d5d61 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:03.617307 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca8504b0-18e8-4c91-97b1-b054a34d5d61 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:03.617845 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca8504b0-18e8-4c91-97b1-b054a34d5d61 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:03.757508 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ca8504b0-18e8-4c91-97b1-b054a34d5d61 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:03.766376 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ca8504b0-18e8-4c91-97b1-b054a34d5d61 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.160734 Apr 11 13:59:03.766943 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 226/453] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:03 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:04.785720 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bbf3539a-f39d-4e90-9daa-9fe7fafa762a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:04.786428 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bbf3539a-f39d-4e90-9daa-9fe7fafa762a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:04.793250 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbf3539a-f39d-4e90-9daa-9fe7fafa762a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:04.795548 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbf3539a-f39d-4e90-9daa-9fe7fafa762a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:04.796405 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbf3539a-f39d-4e90-9daa-9fe7fafa762a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:04.796853 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbf3539a-f39d-4e90-9daa-9fe7fafa762a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:05.065372 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-bbf3539a-f39d-4e90-9daa-9fe7fafa762a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:05.074828 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bbf3539a-f39d-4e90-9daa-9fe7fafa762a tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.294452 Apr 11 13:59:05.075418 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 228/454] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:04 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:05.445332 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-2d1f73ee-c9b0-4b96-b585-e8c644c7d109 req-32b01f93-02df-427e-ac24-a96932985568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a988bf-9fbe-4371-a34f-2437494ec1ee", "tag": "2f18b7d6-84d7-4249-8b95-51fdbd414e68"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:05.456247 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-2d1f73ee-c9b0-4b96-b585-e8c644c7d109 req-32b01f93-02df-427e-ac24-a96932985568 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:05.456796 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-2d1f73ee-c9b0-4b96-b585-e8c644c7d109 req-32b01f93-02df-427e-ac24-a96932985568 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:05.469677 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-2d1f73ee-c9b0-4b96-b585-e8c644c7d109 req-32b01f93-02df-427e-ac24-a96932985568 service nova] Creating event network-changed:2f18b7d6-84d7-4249-8b95-51fdbd414e68 for instance e2a988bf-9fbe-4371-a34f-2437494ec1ee on hv-cinder-83078 Apr 11 13:59:05.475024 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-2d1f73ee-c9b0-4b96-b585-e8c644c7d109 req-32b01f93-02df-427e-ac24-a96932985568 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034550 Apr 11 13:59:05.475786 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 227/455] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:59:06.092544 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f930d576-4a44-4a1c-a3d6-f466763b8b34 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:06.093173 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f930d576-4a44-4a1c-a3d6-f466763b8b34 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:06.099676 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f930d576-4a44-4a1c-a3d6-f466763b8b34 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:06.100261 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f930d576-4a44-4a1c-a3d6-f466763b8b34 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:06.101135 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f930d576-4a44-4a1c-a3d6-f466763b8b34 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:06.101639 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f930d576-4a44-4a1c-a3d6-f466763b8b34 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:06.241730 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f930d576-4a44-4a1c-a3d6-f466763b8b34 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:06.250655 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f930d576-4a44-4a1c-a3d6-f466763b8b34 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.162043 Apr 11 13:59:06.251468 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 229/456] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:06 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:06.394281 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c2fdbb92-9c1d-46a7-b387-e928b5c18563 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:06.395045 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c2fdbb92-9c1d-46a7-b387-e928b5c18563 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:06.401340 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c2fdbb92-9c1d-46a7-b387-e928b5c18563 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:06.401786 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c2fdbb92-9c1d-46a7-b387-e928b5c18563 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:06.402556 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c2fdbb92-9c1d-46a7-b387-e928b5c18563 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:06.402986 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c2fdbb92-9c1d-46a7-b387-e928b5c18563 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:06.534212 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c2fdbb92-9c1d-46a7-b387-e928b5c18563 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:06.542488 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c2fdbb92-9c1d-46a7-b387-e928b5c18563 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1594 microversion: 2.1 time: 0.152329 Apr 11 13:59:06.543204 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 228/457] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:06 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:07.268646 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1d3cbda4-2b6e-4cec-a1b5-9f208ec73c20 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:07.269174 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1d3cbda4-2b6e-4cec-a1b5-9f208ec73c20 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:07.275901 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d3cbda4-2b6e-4cec-a1b5-9f208ec73c20 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:07.276361 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d3cbda4-2b6e-4cec-a1b5-9f208ec73c20 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:07.277191 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d3cbda4-2b6e-4cec-a1b5-9f208ec73c20 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:07.277626 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d3cbda4-2b6e-4cec-a1b5-9f208ec73c20 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:07.491068 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1d3cbda4-2b6e-4cec-a1b5-9f208ec73c20 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:07.499755 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1d3cbda4-2b6e-4cec-a1b5-9f208ec73c20 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.235104 Apr 11 13:59:07.500371 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 230/458] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:07 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:08.517657 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-83b6146a-81c6-4a77-84a0-bfa515a2cea3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:08.518357 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-83b6146a-81c6-4a77-84a0-bfa515a2cea3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:08.524848 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-83b6146a-81c6-4a77-84a0-bfa515a2cea3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:08.525450 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-83b6146a-81c6-4a77-84a0-bfa515a2cea3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:08.526283 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-83b6146a-81c6-4a77-84a0-bfa515a2cea3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:08.526782 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-83b6146a-81c6-4a77-84a0-bfa515a2cea3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:08.539020 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-e8fd6339-fc74-410a-bfb6-28bd5bb7c616 req-fa0abeb6-1d75-4c78-b72e-c77e9f33097b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79569212-4835-45da-92b0-516e527a1f88", "tag": "696c428a-2d32-4149-b9c4-40a4e382593e"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:08.548335 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-e8fd6339-fc74-410a-bfb6-28bd5bb7c616 req-fa0abeb6-1d75-4c78-b72e-c77e9f33097b service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:08.548799 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-e8fd6339-fc74-410a-bfb6-28bd5bb7c616 req-fa0abeb6-1d75-4c78-b72e-c77e9f33097b service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:08.563335 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-e8fd6339-fc74-410a-bfb6-28bd5bb7c616 req-fa0abeb6-1d75-4c78-b72e-c77e9f33097b service nova] Creating event network-changed:696c428a-2d32-4149-b9c4-40a4e382593e for instance 79569212-4835-45da-92b0-516e527a1f88 on hv-cinder-83078 Apr 11 13:59:08.567326 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-e8fd6339-fc74-410a-bfb6-28bd5bb7c616 req-fa0abeb6-1d75-4c78-b72e-c77e9f33097b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032205 Apr 11 13:59:08.567973 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 231/459] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 13:59:08.808439 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-83b6146a-81c6-4a77-84a0-bfa515a2cea3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:08.819904 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-83b6146a-81c6-4a77-84a0-bfa515a2cea3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.306894 Apr 11 13:59:08.821065 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 229/460] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:08 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:09.834295 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-69d9f817-3911-4960-bf0f-45beb783ef50 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-92942565"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:09.834914 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-69d9f817-3911-4960-bf0f-45beb783ef50 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:09.837019 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e65fa579-cfea-4ae0-a2af-757c7d39cad0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:09.837630 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e65fa579-cfea-4ae0-a2af-757c7d39cad0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:09.841890 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-69d9f817-3911-4960-bf0f-45beb783ef50 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:09.842923 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-69d9f817-3911-4960-bf0f-45beb783ef50 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:09.843999 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-69d9f817-3911-4960-bf0f-45beb783ef50 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:09.844231 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-69d9f817-3911-4960-bf0f-45beb783ef50 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:09.847697 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e65fa579-cfea-4ae0-a2af-757c7d39cad0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:09.848822 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e65fa579-cfea-4ae0-a2af-757c7d39cad0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:09.850159 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e65fa579-cfea-4ae0-a2af-757c7d39cad0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:09.850909 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e65fa579-cfea-4ae0-a2af-757c7d39cad0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:09.977870 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.network.security_group_api [None req-69d9f817-3911-4960-bf0f-45beb783ef50 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Adding security group b702b37f-bf09-4495-b518-9860a0ba33cf to port 696c428a-2d32-4149-b9c4-40a4e382593e Apr 11 13:59:10.007840 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e65fa579-cfea-4ae0-a2af-757c7d39cad0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:10.016575 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e65fa579-cfea-4ae0-a2af-757c7d39cad0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.183329 Apr 11 13:59:10.017142 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 230/461] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:09 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:59:10.366813 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-69d9f817-3911-4960-bf0f-45beb783ef50 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "POST /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.536640 Apr 11 13:59:10.367486 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 232/462] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 13:59:09 2022] POST /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 13:59:10.381449 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-346e620f-cc52-4fd9-a8d8-12e951c04b0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:10.382228 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-346e620f-cc52-4fd9-a8d8-12e951c04b0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:10.389764 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-346e620f-cc52-4fd9-a8d8-12e951c04b0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:10.390283 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-346e620f-cc52-4fd9-a8d8-12e951c04b0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:10.391130 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-346e620f-cc52-4fd9-a8d8-12e951c04b0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:10.391788 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-346e620f-cc52-4fd9-a8d8-12e951c04b0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:10.567358 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-346e620f-cc52-4fd9-a8d8-12e951c04b0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:10.576903 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-346e620f-cc52-4fd9-a8d8-12e951c04b0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1757 microversion: 2.1 time: 0.204563 Apr 11 13:59:10.577492 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 231/463] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:10 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:10.581849 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-03656a18-5867-4070-9676-bdfdd93dc263 req-f7067313-17ca-49c7-b1ef-0635318eda0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79569212-4835-45da-92b0-516e527a1f88", "tag": "696c428a-2d32-4149-b9c4-40a4e382593e"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:10.589763 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-03656a18-5867-4070-9676-bdfdd93dc263 req-f7067313-17ca-49c7-b1ef-0635318eda0e service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:10.590222 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-03656a18-5867-4070-9676-bdfdd93dc263 req-f7067313-17ca-49c7-b1ef-0635318eda0e service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:10.601220 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-03656a18-5867-4070-9676-bdfdd93dc263 req-f7067313-17ca-49c7-b1ef-0635318eda0e service nova] Creating event network-changed:696c428a-2d32-4149-b9c4-40a4e382593e for instance 79569212-4835-45da-92b0-516e527a1f88 on hv-cinder-83078 Apr 11 13:59:10.606607 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-03656a18-5867-4070-9676-bdfdd93dc263 req-f7067313-17ca-49c7-b1ef-0635318eda0e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028194 Apr 11 13:59:10.608122 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 233/464] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 13:59:11.033313 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-19a85073-9e08-449a-bf2e-b1d37ab94d11 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:11.033930 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-19a85073-9e08-449a-bf2e-b1d37ab94d11 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:11.040759 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19a85073-9e08-449a-bf2e-b1d37ab94d11 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:11.041217 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19a85073-9e08-449a-bf2e-b1d37ab94d11 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:11.041992 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19a85073-9e08-449a-bf2e-b1d37ab94d11 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:11.042602 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19a85073-9e08-449a-bf2e-b1d37ab94d11 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:11.238698 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-19a85073-9e08-449a-bf2e-b1d37ab94d11 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:11.246318 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-19a85073-9e08-449a-bf2e-b1d37ab94d11 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.217365 Apr 11 13:59:11.246884 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 232/465] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:11 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:12.265074 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7912c76a-f4c3-4967-b7ea-829b7b0f95f9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:12.265724 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7912c76a-f4c3-4967-b7ea-829b7b0f95f9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:12.271841 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7912c76a-f4c3-4967-b7ea-829b7b0f95f9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:12.272291 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7912c76a-f4c3-4967-b7ea-829b7b0f95f9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:12.273047 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7912c76a-f4c3-4967-b7ea-829b7b0f95f9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:12.273475 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7912c76a-f4c3-4967-b7ea-829b7b0f95f9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:12.401828 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7912c76a-f4c3-4967-b7ea-829b7b0f95f9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:12.410181 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7912c76a-f4c3-4967-b7ea-829b7b0f95f9 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.150000 Apr 11 13:59:12.410749 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 234/466] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:12 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:13.067184 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-630b9ce2-949b-4820-a62b-8098d77cbbff tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c957f1a9-83de-444a-912a-3ac0318e8a0a", "device": "/dev/sdb"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:13.068843 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-630b9ce2-949b-4820-a62b-8098d77cbbff tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:13.075090 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-630b9ce2-949b-4820-a62b-8098d77cbbff tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:13.075567 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-630b9ce2-949b-4820-a62b-8098d77cbbff tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:13.076382 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-630b9ce2-949b-4820-a62b-8098d77cbbff tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:13.076820 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-630b9ce2-949b-4820-a62b-8098d77cbbff tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:13.308581 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-630b9ce2-949b-4820-a62b-8098d77cbbff tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "POST /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245219 Apr 11 13:59:13.309240 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 233/467] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 13:59:13 2022] POST /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:59:13.427886 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bab1006e-4cf8-4124-b6c2-0895955d3d7d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:13.428503 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bab1006e-4cf8-4124-b6c2-0895955d3d7d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:13.434632 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bab1006e-4cf8-4124-b6c2-0895955d3d7d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:13.435079 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bab1006e-4cf8-4124-b6c2-0895955d3d7d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:13.435869 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bab1006e-4cf8-4124-b6c2-0895955d3d7d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:13.436301 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bab1006e-4cf8-4124-b6c2-0895955d3d7d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:13.568986 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-bab1006e-4cf8-4124-b6c2-0895955d3d7d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:13.577121 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bab1006e-4cf8-4124-b6c2-0895955d3d7d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.152980 Apr 11 13:59:13.577678 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 235/468] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:13 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:14.595616 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f5f201b4-c1b3-4ac1-aa0f-78fa95ee799c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:14.596383 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f5f201b4-c1b3-4ac1-aa0f-78fa95ee799c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:14.602499 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f5f201b4-c1b3-4ac1-aa0f-78fa95ee799c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:14.602952 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f5f201b4-c1b3-4ac1-aa0f-78fa95ee799c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:14.603746 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f5f201b4-c1b3-4ac1-aa0f-78fa95ee799c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:14.604186 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f5f201b4-c1b3-4ac1-aa0f-78fa95ee799c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:14.736017 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f5f201b4-c1b3-4ac1-aa0f-78fa95ee799c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:14.743812 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f5f201b4-c1b3-4ac1-aa0f-78fa95ee799c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.153514 Apr 11 13:59:14.744374 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 234/469] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:14 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:15.760939 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-01ee2a0e-99bf-4699-a423-6416ff91d613 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:15.761550 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-01ee2a0e-99bf-4699-a423-6416ff91d613 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:15.768333 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-01ee2a0e-99bf-4699-a423-6416ff91d613 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:15.768779 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-01ee2a0e-99bf-4699-a423-6416ff91d613 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:15.769535 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-01ee2a0e-99bf-4699-a423-6416ff91d613 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:15.770067 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-01ee2a0e-99bf-4699-a423-6416ff91d613 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:15.896979 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-01ee2a0e-99bf-4699-a423-6416ff91d613 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:15.905424 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-01ee2a0e-99bf-4699-a423-6416ff91d613 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.148332 Apr 11 13:59:15.905990 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 236/470] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:15 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:16.922381 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5f15b7f0-1de7-4bdd-b2a2-fdb92ef7d524 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:16.922994 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5f15b7f0-1de7-4bdd-b2a2-fdb92ef7d524 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:16.929245 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f15b7f0-1de7-4bdd-b2a2-fdb92ef7d524 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:16.929694 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f15b7f0-1de7-4bdd-b2a2-fdb92ef7d524 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:16.930455 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f15b7f0-1de7-4bdd-b2a2-fdb92ef7d524 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:16.930885 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f15b7f0-1de7-4bdd-b2a2-fdb92ef7d524 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:17.060881 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5f15b7f0-1de7-4bdd-b2a2-fdb92ef7d524 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:17.068693 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5f15b7f0-1de7-4bdd-b2a2-fdb92ef7d524 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1733 microversion: 2.1 time: 0.150363 Apr 11 13:59:17.069261 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 235/471] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:16 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:18.087508 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7f0840d7-3e6a-460d-a114-9ff18eb30ff3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:18.088151 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7f0840d7-3e6a-460d-a114-9ff18eb30ff3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:18.094825 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7f0840d7-3e6a-460d-a114-9ff18eb30ff3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:18.095275 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7f0840d7-3e6a-460d-a114-9ff18eb30ff3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:18.096066 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7f0840d7-3e6a-460d-a114-9ff18eb30ff3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:18.096501 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7f0840d7-3e6a-460d-a114-9ff18eb30ff3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:18.221315 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7f0840d7-3e6a-460d-a114-9ff18eb30ff3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:18.228967 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7f0840d7-3e6a-460d-a114-9ff18eb30ff3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1713 microversion: 2.1 time: 0.145246 Apr 11 13:59:18.229528 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 237/472] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:18 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1713 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:18.326837 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b86a1d8e-b814-40c6-b9db-ce80071b028c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:18.327331 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b86a1d8e-b814-40c6-b9db-ce80071b028c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:18.333538 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b86a1d8e-b814-40c6-b9db-ce80071b028c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:18.333981 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b86a1d8e-b814-40c6-b9db-ce80071b028c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:18.334734 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b86a1d8e-b814-40c6-b9db-ce80071b028c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:18.335164 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b86a1d8e-b814-40c6-b9db-ce80071b028c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:18.455682 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-b86a1d8e-b814-40c6-b9db-ce80071b028c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] HTTP exception thrown: Cannot 'detach_volume' instance a1b122bc-5193-4642-9f21-0e30c573c88e while it is in vm_state rescued Apr 11 13:59:18.456283 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b86a1d8e-b814-40c6-b9db-ce80071b028c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Returning 409 to user: Cannot 'detach_volume' instance a1b122bc-5193-4642-9f21-0e30c573c88e while it is in vm_state rescued {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:59:18.457125 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b86a1d8e-b814-40c6-b9db-ce80071b028c tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments/bba0bb7d-357b-4178-9762-fbd709ee3cb7" status: 409 len: 152 microversion: 2.1 time: 0.134901 Apr 11 13:59:18.457711 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 236/473] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Apr 11 13:59:18 2022] DELETE /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments/bba0bb7d-357b-4178-9762-fbd709ee3cb7 => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 13:59:18.466844 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-206996b2-3fa8-4cc0-8ecf-46f0d22dc36f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:18.467401 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-206996b2-3fa8-4cc0-8ecf-46f0d22dc36f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:18.473219 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-206996b2-3fa8-4cc0-8ecf-46f0d22dc36f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:18.473678 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-206996b2-3fa8-4cc0-8ecf-46f0d22dc36f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:18.474445 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-206996b2-3fa8-4cc0-8ecf-46f0d22dc36f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:18.474886 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-206996b2-3fa8-4cc0-8ecf-46f0d22dc36f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:18.540831 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-206996b2-3fa8-4cc0-8ecf-46f0d22dc36f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "POST /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/action" status: 202 len: 0 microversion: 2.1 time: 0.077736 Apr 11 13:59:18.541451 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 238/474] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 13:59:18 2022] POST /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 13:59:18.550300 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e345ce8a-34ba-4ccb-b396-f6034dfae8bd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:18.550907 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e345ce8a-34ba-4ccb-b396-f6034dfae8bd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:18.557728 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e345ce8a-34ba-4ccb-b396-f6034dfae8bd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:18.558173 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e345ce8a-34ba-4ccb-b396-f6034dfae8bd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:18.559095 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e345ce8a-34ba-4ccb-b396-f6034dfae8bd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:18.559521 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e345ce8a-34ba-4ccb-b396-f6034dfae8bd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:18.768263 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e345ce8a-34ba-4ccb-b396-f6034dfae8bd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:18.776222 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e345ce8a-34ba-4ccb-b396-f6034dfae8bd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1721 microversion: 2.1 time: 0.229680 Apr 11 13:59:18.776893 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 237/475] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:18 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:19.794032 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f57ea763-9e69-4d3d-aee7-f008ab337cba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:19.796014 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f57ea763-9e69-4d3d-aee7-f008ab337cba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:19.802783 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f57ea763-9e69-4d3d-aee7-f008ab337cba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:19.802985 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f57ea763-9e69-4d3d-aee7-f008ab337cba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:19.803797 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f57ea763-9e69-4d3d-aee7-f008ab337cba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:19.804232 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f57ea763-9e69-4d3d-aee7-f008ab337cba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:19.932004 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f57ea763-9e69-4d3d-aee7-f008ab337cba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:19.939933 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f57ea763-9e69-4d3d-aee7-f008ab337cba tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1721 microversion: 2.1 time: 0.150255 Apr 11 13:59:19.940506 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 239/476] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:19 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:20.957100 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a8fe482b-21f6-4b38-b8e5-3e78f4872df5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:20.957757 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a8fe482b-21f6-4b38-b8e5-3e78f4872df5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:20.964072 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a8fe482b-21f6-4b38-b8e5-3e78f4872df5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:20.964523 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a8fe482b-21f6-4b38-b8e5-3e78f4872df5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:20.965336 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a8fe482b-21f6-4b38-b8e5-3e78f4872df5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:20.965926 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a8fe482b-21f6-4b38-b8e5-3e78f4872df5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:21.090812 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a8fe482b-21f6-4b38-b8e5-3e78f4872df5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:21.098487 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a8fe482b-21f6-4b38-b8e5-3e78f4872df5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1721 microversion: 2.1 time: 0.145417 Apr 11 13:59:21.099055 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 238/477] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:20 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:22.115751 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-65634ea2-bb75-4436-9606-882e97b6e448 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:22.116374 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-65634ea2-bb75-4436-9606-882e97b6e448 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:22.122714 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-65634ea2-bb75-4436-9606-882e97b6e448 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:22.123170 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-65634ea2-bb75-4436-9606-882e97b6e448 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:22.124184 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-65634ea2-bb75-4436-9606-882e97b6e448 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:22.124630 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-65634ea2-bb75-4436-9606-882e97b6e448 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:22.252058 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-65634ea2-bb75-4436-9606-882e97b6e448 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:22.259714 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-65634ea2-bb75-4436-9606-882e97b6e448 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1721 microversion: 2.1 time: 0.147817 Apr 11 13:59:22.260289 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 240/478] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:22 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:23.276586 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ce9973bd-17e6-4d5e-b6ef-8412c001d4f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:23.277126 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ce9973bd-17e6-4d5e-b6ef-8412c001d4f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:23.284041 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce9973bd-17e6-4d5e-b6ef-8412c001d4f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:23.284498 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce9973bd-17e6-4d5e-b6ef-8412c001d4f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:23.285268 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce9973bd-17e6-4d5e-b6ef-8412c001d4f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:23.285707 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce9973bd-17e6-4d5e-b6ef-8412c001d4f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:23.415096 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ce9973bd-17e6-4d5e-b6ef-8412c001d4f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:23.423543 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ce9973bd-17e6-4d5e-b6ef-8412c001d4f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1721 microversion: 2.1 time: 0.150867 Apr 11 13:59:23.424132 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 239/479] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:23 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:24.440513 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9232f910-5d8f-4c22-ae60-937467ee2663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:24.441140 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9232f910-5d8f-4c22-ae60-937467ee2663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:24.447437 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9232f910-5d8f-4c22-ae60-937467ee2663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:24.447923 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9232f910-5d8f-4c22-ae60-937467ee2663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:24.448695 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9232f910-5d8f-4c22-ae60-937467ee2663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:24.449140 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9232f910-5d8f-4c22-ae60-937467ee2663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:24.573641 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9232f910-5d8f-4c22-ae60-937467ee2663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:24.581963 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9232f910-5d8f-4c22-ae60-937467ee2663 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1721 microversion: 2.1 time: 0.145264 Apr 11 13:59:24.582534 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 241/480] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:24 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:25.599387 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2a0ab7c1-295f-4cef-a60f-3c6fc771933f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:25.600024 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2a0ab7c1-295f-4cef-a60f-3c6fc771933f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:25.606565 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2a0ab7c1-295f-4cef-a60f-3c6fc771933f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:25.607124 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2a0ab7c1-295f-4cef-a60f-3c6fc771933f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:25.607917 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2a0ab7c1-295f-4cef-a60f-3c6fc771933f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:25.608359 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2a0ab7c1-295f-4cef-a60f-3c6fc771933f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:25.733446 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2a0ab7c1-295f-4cef-a60f-3c6fc771933f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:25.741080 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2a0ab7c1-295f-4cef-a60f-3c6fc771933f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1721 microversion: 2.1 time: 0.145466 Apr 11 13:59:25.741647 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 240/481] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:25 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:26.758371 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-13563d16-76e4-47a8-a578-f0fd052074f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:26.758983 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-13563d16-76e4-47a8-a578-f0fd052074f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:26.766322 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-13563d16-76e4-47a8-a578-f0fd052074f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:26.766772 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-13563d16-76e4-47a8-a578-f0fd052074f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:26.767528 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-13563d16-76e4-47a8-a578-f0fd052074f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:26.767992 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-13563d16-76e4-47a8-a578-f0fd052074f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:26.894893 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-13563d16-76e4-47a8-a578-f0fd052074f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:26.902528 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-13563d16-76e4-47a8-a578-f0fd052074f0 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1721 microversion: 2.1 time: 0.148109 Apr 11 13:59:26.903074 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 242/482] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:26 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:27.920780 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ab133f1a-8de7-4174-9897-8c327e22a027 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:27.921393 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ab133f1a-8de7-4174-9897-8c327e22a027 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:27.927700 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab133f1a-8de7-4174-9897-8c327e22a027 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:27.928156 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab133f1a-8de7-4174-9897-8c327e22a027 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:27.928928 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab133f1a-8de7-4174-9897-8c327e22a027 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:27.929368 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab133f1a-8de7-4174-9897-8c327e22a027 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:28.058995 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ab133f1a-8de7-4174-9897-8c327e22a027 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:28.066779 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ab133f1a-8de7-4174-9897-8c327e22a027 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1721 microversion: 2.1 time: 0.150277 Apr 11 13:59:28.067341 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 241/483] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:27 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:29.083385 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-35218074-14e7-4d0d-b949-09a8639c976e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:29.083956 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-35218074-14e7-4d0d-b949-09a8639c976e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:29.090241 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35218074-14e7-4d0d-b949-09a8639c976e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:29.090826 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35218074-14e7-4d0d-b949-09a8639c976e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:29.091668 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35218074-14e7-4d0d-b949-09a8639c976e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:29.092113 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35218074-14e7-4d0d-b949-09a8639c976e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:29.219812 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-35218074-14e7-4d0d-b949-09a8639c976e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:29.227532 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-35218074-14e7-4d0d-b949-09a8639c976e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1727 microversion: 2.1 time: 0.148124 Apr 11 13:59:29.228128 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 243/484] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:29 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:29.244431 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2182e35c-02f0-4bc2-8a83-6eda6ca4f458 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:29.244924 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2182e35c-02f0-4bc2-8a83-6eda6ca4f458 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:29.251992 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2182e35c-02f0-4bc2-8a83-6eda6ca4f458 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:29.252445 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2182e35c-02f0-4bc2-8a83-6eda6ca4f458 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:29.253208 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2182e35c-02f0-4bc2-8a83-6eda6ca4f458 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:29.253646 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2182e35c-02f0-4bc2-8a83-6eda6ca4f458 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:29.331409 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2182e35c-02f0-4bc2-8a83-6eda6ca4f458 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090754 Apr 11 13:59:29.332064 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 242/485] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Apr 11 13:59:29 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:59:30.451027 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-981c94fe-b988-4066-86e0-12868e8f9d61 req-12a1aa64-be88-4426-86a8-4df5f4da7c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b122bc-5193-4642-9f21-0e30c573c88e", "tag": "dd31c02f-d45d-4905-89c8-0c0d76d81cb0"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:30.459492 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-981c94fe-b988-4066-86e0-12868e8f9d61 req-12a1aa64-be88-4426-86a8-4df5f4da7c56 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:30.460544 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-981c94fe-b988-4066-86e0-12868e8f9d61 req-12a1aa64-be88-4426-86a8-4df5f4da7c56 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:30.480895 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-981c94fe-b988-4066-86e0-12868e8f9d61 req-12a1aa64-be88-4426-86a8-4df5f4da7c56 service nova] Creating event network-changed:dd31c02f-d45d-4905-89c8-0c0d76d81cb0 for instance a1b122bc-5193-4642-9f21-0e30c573c88e on hv-cinder-83078 Apr 11 13:59:30.490238 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-981c94fe-b988-4066-86e0-12868e8f9d61 req-12a1aa64-be88-4426-86a8-4df5f4da7c56 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042717 Apr 11 13:59:30.491074 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 244/486] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:59:32.507144 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-a422924a-7550-4203-93b7-53b6088378d9 req-93b13c65-76e8-43dd-bd6d-5618a97630b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b122bc-5193-4642-9f21-0e30c573c88e", "tag": "dd31c02f-d45d-4905-89c8-0c0d76d81cb0"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:32.515594 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-a422924a-7550-4203-93b7-53b6088378d9 req-93b13c65-76e8-43dd-bd6d-5618a97630b4 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:32.516049 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-a422924a-7550-4203-93b7-53b6088378d9 req-93b13c65-76e8-43dd-bd6d-5618a97630b4 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:32.526788 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-a422924a-7550-4203-93b7-53b6088378d9 req-93b13c65-76e8-43dd-bd6d-5618a97630b4 service nova] Creating event network-changed:dd31c02f-d45d-4905-89c8-0c0d76d81cb0 for instance a1b122bc-5193-4642-9f21-0e30c573c88e on hv-cinder-83078 Apr 11 13:59:32.540796 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-a422924a-7550-4203-93b7-53b6088378d9 req-93b13c65-76e8-43dd-bd6d-5618a97630b4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037476 Apr 11 13:59:32.541444 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 243/487] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:59:36.889352 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8a61328d-9b15-4d45-8a12-61f4449f6214 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:36.889942 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8a61328d-9b15-4d45-8a12-61f4449f6214 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:36.895905 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8a61328d-9b15-4d45-8a12-61f4449f6214 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:36.896352 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8a61328d-9b15-4d45-8a12-61f4449f6214 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:36.897111 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8a61328d-9b15-4d45-8a12-61f4449f6214 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:36.897546 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8a61328d-9b15-4d45-8a12-61f4449f6214 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:37.018770 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-8a61328d-9b15-4d45-8a12-61f4449f6214 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lazy-loading 'services' on Instance uuid 94420324-3720-447d-b195-df28fb7d8fc7 {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 13:59:37.131472 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8a61328d-9b15-4d45-8a12-61f4449f6214 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "DELETE /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7/os-volume_attachments/c957f1a9-83de-444a-912a-3ac0318e8a0a" status: 202 len: 0 microversion: 2.1 time: 0.246771 Apr 11 13:59:37.132083 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 245/488] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Apr 11 13:59:36 2022] DELETE /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7/os-volume_attachments/c957f1a9-83de-444a-912a-3ac0318e8a0a => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 13:59:38.244539 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4b05d069-61ad-4f7b-b3fa-2cbc9d9a513b tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:38.245125 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4b05d069-61ad-4f7b-b3fa-2cbc9d9a513b tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:38.252246 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b05d069-61ad-4f7b-b3fa-2cbc9d9a513b tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:38.252691 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b05d069-61ad-4f7b-b3fa-2cbc9d9a513b tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:38.253471 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b05d069-61ad-4f7b-b3fa-2cbc9d9a513b tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:38.253903 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b05d069-61ad-4f7b-b3fa-2cbc9d9a513b tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:38.276861 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4b05d069-61ad-4f7b-b3fa-2cbc9d9a513b tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 13:59:38.356314 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4b05d069-61ad-4f7b-b3fa-2cbc9d9a513b tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "DELETE /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 204 len: 0 microversion: 2.1 time: 0.115551 Apr 11 13:59:38.356922 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 244/489] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 13:59:38 2022] DELETE /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 13:59:38.366301 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-571a2b39-d629-46de-a8ce-51ce2b423656 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:38.367009 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-571a2b39-d629-46de-a8ce-51ce2b423656 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:38.374160 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-571a2b39-d629-46de-a8ce-51ce2b423656 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:38.374607 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-571a2b39-d629-46de-a8ce-51ce2b423656 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:38.375374 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-571a2b39-d629-46de-a8ce-51ce2b423656 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:38.375846 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-571a2b39-d629-46de-a8ce-51ce2b423656 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:38.504497 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-571a2b39-d629-46de-a8ce-51ce2b423656 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:38.511857 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-571a2b39-d629-46de-a8ce-51ce2b423656 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1513 microversion: 2.1 time: 0.149728 Apr 11 13:59:38.512424 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 246/490] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:38 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:39.530646 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5c8c6ba0-bc2a-411a-80b9-f1ba5f50d6a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:39.531350 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5c8c6ba0-bc2a-411a-80b9-f1ba5f50d6a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:39.537883 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c8c6ba0-bc2a-411a-80b9-f1ba5f50d6a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:39.538336 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c8c6ba0-bc2a-411a-80b9-f1ba5f50d6a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:39.539109 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c8c6ba0-bc2a-411a-80b9-f1ba5f50d6a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:39.539547 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c8c6ba0-bc2a-411a-80b9-f1ba5f50d6a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:39.669359 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5c8c6ba0-bc2a-411a-80b9-f1ba5f50d6a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:39.677217 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5c8c6ba0-bc2a-411a-80b9-f1ba5f50d6a6 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1513 microversion: 2.1 time: 0.150987 Apr 11 13:59:39.677786 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 245/491] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:39 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:40.695205 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f85d5b5d-60be-4568-b2e8-5310615783de tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:40.695986 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f85d5b5d-60be-4568-b2e8-5310615783de tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:40.702861 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f85d5b5d-60be-4568-b2e8-5310615783de tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:40.703321 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f85d5b5d-60be-4568-b2e8-5310615783de tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:40.704121 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f85d5b5d-60be-4568-b2e8-5310615783de tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:40.704569 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f85d5b5d-60be-4568-b2e8-5310615783de tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:40.838282 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f85d5b5d-60be-4568-b2e8-5310615783de tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:40.846722 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f85d5b5d-60be-4568-b2e8-5310615783de tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 200 len: 1513 microversion: 2.1 time: 0.155455 Apr 11 13:59:40.847494 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 247/492] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:40 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:40.939981 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-d263b025-d468-42d7-8b5b-b3483e916cc7 req-2d35060c-d4b9-43fc-8a8b-22bc1f172c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94420324-3720-447d-b195-df28fb7d8fc7", "name": "network-vif-deleted", "tag": "ff4c3178-c740-4cea-87a2-4bed198b02e0"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:40.951588 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-d263b025-d468-42d7-8b5b-b3483e916cc7 req-2d35060c-d4b9-43fc-8a8b-22bc1f172c57 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:40.951989 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-d263b025-d468-42d7-8b5b-b3483e916cc7 req-2d35060c-d4b9-43fc-8a8b-22bc1f172c57 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:40.963234 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-d263b025-d468-42d7-8b5b-b3483e916cc7 req-2d35060c-d4b9-43fc-8a8b-22bc1f172c57 service nova] Creating event network-vif-deleted:ff4c3178-c740-4cea-87a2-4bed198b02e0 for instance 94420324-3720-447d-b195-df28fb7d8fc7 on hv-cinder-83078 Apr 11 13:59:40.969750 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-d263b025-d468-42d7-8b5b-b3483e916cc7 req-2d35060c-d4b9-43fc-8a8b-22bc1f172c57 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033351 Apr 11 13:59:40.970342 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 246/493] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:59:41.865344 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-413ae179-cac8-43a2-820e-afde747b875e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:41.865995 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-413ae179-cac8-43a2-820e-afde747b875e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 94420324-3720-447d-b195-df28fb7d8fc7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:41.872321 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-413ae179-cac8-43a2-820e-afde747b875e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:41.872917 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-413ae179-cac8-43a2-820e-afde747b875e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:41.873712 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-413ae179-cac8-43a2-820e-afde747b875e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:41.874150 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-413ae179-cac8-43a2-820e-afde747b875e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:41.886705 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-413ae179-cac8-43a2-820e-afde747b875e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] HTTP exception thrown: Instance 94420324-3720-447d-b195-df28fb7d8fc7 could not be found. Apr 11 13:59:41.887290 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-413ae179-cac8-43a2-820e-afde747b875e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Returning 404 to user: Instance 94420324-3720-447d-b195-df28fb7d8fc7 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 13:59:41.888684 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-413ae179-cac8-43a2-820e-afde747b875e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7" status: 404 len: 111 microversion: 2.1 time: 0.026789 Apr 11 13:59:41.889205 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 248/494] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:41 2022] GET /compute/v2.1/servers/94420324-3720-447d-b195-df28fb7d8fc7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 13:59:49.465313 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-357e767c-87d2-4df1-a504-d7d32c6c4f25 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:49.465894 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-357e767c-87d2-4df1-a504-d7d32c6c4f25 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:49.473210 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-357e767c-87d2-4df1-a504-d7d32c6c4f25 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:49.473659 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-357e767c-87d2-4df1-a504-d7d32c6c4f25 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:49.474421 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-357e767c-87d2-4df1-a504-d7d32c6c4f25 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:49.474857 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-357e767c-87d2-4df1-a504-d7d32c6c4f25 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:49.551522 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-357e767c-87d2-4df1-a504-d7d32c6c4f25 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lazy-loading 'services' on Instance uuid 54dcdce4-931a-42d3-b36a-321afffabdc0 {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 13:59:49.624752 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-374113333", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "networks": [{"uuid": "cf99eff9-c390-41f8-af4b-89bf18e9fd64"}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:49.667322 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-357e767c-87d2-4df1-a504-d7d32c6c4f25 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "DELETE /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/os-volume_attachments/68f53176-b8e7-41ea-b2f3-abe907a54b9d" status: 202 len: 0 microversion: 2.1 time: 0.206033 Apr 11 13:59:49.667972 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 247/495] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Apr 11 13:59:49 2022] DELETE /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/os-volume_attachments/68f53176-b8e7-41ea-b2f3-abe907a54b9d => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 13:59:49.680850 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] validate_networks() for [('cf99eff9-c390-41f8-af4b-89bf18e9fd64', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 13:59:50.020655 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 13:59:50.021085 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 13:59:50.021562 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 13:59:50.021977 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 13:59:50.022400 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 13:59:50.032657 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:50.033113 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:50.033921 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:50.034625 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:50.050653 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Getting quotas for project 62982ff988ec462a8189ea9ba7c8496b. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 13:59:50.054547 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Getting quotas for user f57da915d2c14f1484f6a30c86d4eadd and project 62982ff988ec462a8189ea9ba7c8496b. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 13:59:50.065590 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 13:59:50.067945 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 13:59:50.113306 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-21ab6024-d5ed-41c4-aa0d-8554f92dac3a tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492859 Apr 11 13:59:50.113939 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 249/496] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 13:59:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 11 13:59:50.124734 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f360f3e7-89e0-44fd-93c6-264b56e1bdaf tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:50.125467 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f360f3e7-89e0-44fd-93c6-264b56e1bdaf tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:50.181927 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f360f3e7-89e0-44fd-93c6-264b56e1bdaf tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:50.191129 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f360f3e7-89e0-44fd-93c6-264b56e1bdaf tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 200 len: 1218 microversion: 2.1 time: 0.070784 Apr 11 13:59:50.192100 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 248/497] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:50 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:50.786245 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-dd86c713-696c-48b8-8ff3-c3520df5910b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:50.792244 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dd86c713-696c-48b8-8ff3-c3520df5910b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:50.792701 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dd86c713-696c-48b8-8ff3-c3520df5910b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:50.813534 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-dd86c713-696c-48b8-8ff3-c3520df5910b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Going to try to stop instance {{(pid=116941) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 11 13:59:50.853140 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-dd86c713-696c-48b8-8ff3-c3520df5910b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "POST /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/action" status: 202 len: 0 microversion: 2.1 time: 0.071338 Apr 11 13:59:50.853720 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 250/498] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 13:59:50 2022] POST /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 13:59:50.861899 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4853df10-17b0-4feb-b697-4322988944d0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:50.862506 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4853df10-17b0-4feb-b697-4322988944d0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:50.869337 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4853df10-17b0-4feb-b697-4322988944d0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:50.869782 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4853df10-17b0-4feb-b697-4322988944d0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:50.870535 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4853df10-17b0-4feb-b697-4322988944d0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:50.870968 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4853df10-17b0-4feb-b697-4322988944d0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:50.997466 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4853df10-17b0-4feb-b697-4322988944d0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:51.004858 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4853df10-17b0-4feb-b697-4322988944d0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.146782 Apr 11 13:59:51.005416 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 249/499] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:50 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:59:51.209765 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-041a8587-866b-4f38-abe1-af85acfb959e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:51.210507 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-041a8587-866b-4f38-abe1-af85acfb959e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:51.218237 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-041a8587-866b-4f38-abe1-af85acfb959e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:51.219185 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-041a8587-866b-4f38-abe1-af85acfb959e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:51.220237 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-041a8587-866b-4f38-abe1-af85acfb959e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:51.220917 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-041a8587-866b-4f38-abe1-af85acfb959e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:51.284375 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-041a8587-866b-4f38-abe1-af85acfb959e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:51.293524 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-041a8587-866b-4f38-abe1-af85acfb959e tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 200 len: 1288 microversion: 2.1 time: 0.088297 Apr 11 13:59:51.294151 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 251/500] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:51 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:52.022933 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e3b68b14-3c6b-41e4-9c63-c33a6d35fb57 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:52.023484 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e3b68b14-3c6b-41e4-9c63-c33a6d35fb57 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:52.029684 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e3b68b14-3c6b-41e4-9c63-c33a6d35fb57 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:52.030124 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e3b68b14-3c6b-41e4-9c63-c33a6d35fb57 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:52.030881 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e3b68b14-3c6b-41e4-9c63-c33a6d35fb57 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:52.031307 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e3b68b14-3c6b-41e4-9c63-c33a6d35fb57 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:52.217256 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e3b68b14-3c6b-41e4-9c63-c33a6d35fb57 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:52.227525 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e3b68b14-3c6b-41e4-9c63-c33a6d35fb57 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.208510 Apr 11 13:59:52.228267 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 250/501] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:52 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:52.313118 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-931c15be-77a2-4678-bee8-0160a356ddad tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:52.314251 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-931c15be-77a2-4678-bee8-0160a356ddad tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:52.320592 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-931c15be-77a2-4678-bee8-0160a356ddad tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:52.321053 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-931c15be-77a2-4678-bee8-0160a356ddad tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:52.321892 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-931c15be-77a2-4678-bee8-0160a356ddad tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:52.322434 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-931c15be-77a2-4678-bee8-0160a356ddad tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:52.389409 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-6ba55d66-dc25-49c6-9a1f-bfaddcf603b7 req-cb3bdd7f-ca2d-44da-9f62-2df004577a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12dff082-2604-43ab-bc96-80955e79ee1a", "tag": "21c45b08-b8bb-4b42-b109-35cb831c8138"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:52.398140 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-6ba55d66-dc25-49c6-9a1f-bfaddcf603b7 req-cb3bdd7f-ca2d-44da-9f62-2df004577a61 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:52.398637 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-6ba55d66-dc25-49c6-9a1f-bfaddcf603b7 req-cb3bdd7f-ca2d-44da-9f62-2df004577a61 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:52.410702 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-6ba55d66-dc25-49c6-9a1f-bfaddcf603b7 req-cb3bdd7f-ca2d-44da-9f62-2df004577a61 service nova] Creating event network-changed:21c45b08-b8bb-4b42-b109-35cb831c8138 for instance 12dff082-2604-43ab-bc96-80955e79ee1a on hv-cinder-83078 Apr 11 13:59:52.415514 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-6ba55d66-dc25-49c6-9a1f-bfaddcf603b7 req-cb3bdd7f-ca2d-44da-9f62-2df004577a61 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029822 Apr 11 13:59:52.416470 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 251/502] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:59:52.467527 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-931c15be-77a2-4678-bee8-0160a356ddad tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:52.474951 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-931c15be-77a2-4678-bee8-0160a356ddad tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 200 len: 1318 microversion: 2.1 time: 0.166203 Apr 11 13:59:52.475526 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 252/503] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:52 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:53.161070 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7fd0dac1-3863-470a-9eae-69eb8ca1ba79 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:53.162107 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7fd0dac1-3863-470a-9eae-69eb8ca1ba79 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:53.168251 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7fd0dac1-3863-470a-9eae-69eb8ca1ba79 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:53.168704 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7fd0dac1-3863-470a-9eae-69eb8ca1ba79 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:53.169724 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7fd0dac1-3863-470a-9eae-69eb8ca1ba79 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:53.170169 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7fd0dac1-3863-470a-9eae-69eb8ca1ba79 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:53.238161 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7fd0dac1-3863-470a-9eae-69eb8ca1ba79 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "POST /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.081814 Apr 11 13:59:53.241771 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 252/504] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 13:59:53 2022] POST /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 13:59:53.246647 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-af265aaf-0eac-4d27-9c7e-edf4e40192fc tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:53.247212 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-02186ab9-4cd8-4b18-82c4-a70c97d62b9b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:53.247338 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-af265aaf-0eac-4d27-9c7e-edf4e40192fc tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:53.247988 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-02186ab9-4cd8-4b18-82c4-a70c97d62b9b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:53.253602 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-af265aaf-0eac-4d27-9c7e-edf4e40192fc tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:53.253922 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-02186ab9-4cd8-4b18-82c4-a70c97d62b9b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:53.254060 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-af265aaf-0eac-4d27-9c7e-edf4e40192fc tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:53.254378 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-02186ab9-4cd8-4b18-82c4-a70c97d62b9b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:53.254837 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-af265aaf-0eac-4d27-9c7e-edf4e40192fc tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:53.255147 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-02186ab9-4cd8-4b18-82c4-a70c97d62b9b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:53.255281 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-af265aaf-0eac-4d27-9c7e-edf4e40192fc tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:53.255586 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-02186ab9-4cd8-4b18-82c4-a70c97d62b9b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:53.389462 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-02186ab9-4cd8-4b18-82c4-a70c97d62b9b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:53.397300 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-02186ab9-4cd8-4b18-82c4-a70c97d62b9b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.154245 Apr 11 13:59:53.401486 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-af265aaf-0eac-4d27-9c7e-edf4e40192fc tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:53.402698 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 253/505] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:53 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:53.410542 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-af265aaf-0eac-4d27-9c7e-edf4e40192fc tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1749 microversion: 2.1 time: 0.167685 Apr 11 13:59:53.411166 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 253/506] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:53 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:53.492615 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-14e84b4b-8c4f-419c-a75c-bd7fc4137de5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:53.493247 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-14e84b4b-8c4f-419c-a75c-bd7fc4137de5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:53.499187 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-14e84b4b-8c4f-419c-a75c-bd7fc4137de5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:53.499705 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-14e84b4b-8c4f-419c-a75c-bd7fc4137de5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:53.500486 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-14e84b4b-8c4f-419c-a75c-bd7fc4137de5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:53.500923 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-14e84b4b-8c4f-419c-a75c-bd7fc4137de5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:53.627045 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-14e84b4b-8c4f-419c-a75c-bd7fc4137de5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:53.634321 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-14e84b4b-8c4f-419c-a75c-bd7fc4137de5 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 200 len: 1318 microversion: 2.1 time: 0.145485 Apr 11 13:59:53.634892 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 254/507] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:53 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:54.414982 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-59c9d856-8eb8-475a-9225-3b93625bc832 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:54.415492 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-59c9d856-8eb8-475a-9225-3b93625bc832 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:54.421433 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59c9d856-8eb8-475a-9225-3b93625bc832 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:54.421888 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59c9d856-8eb8-475a-9225-3b93625bc832 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:54.422677 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59c9d856-8eb8-475a-9225-3b93625bc832 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:54.423114 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59c9d856-8eb8-475a-9225-3b93625bc832 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:54.427421 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-136a1887-f901-4525-890e-1b4d54ba5981 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:54.428069 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-136a1887-f901-4525-890e-1b4d54ba5981 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:54.434186 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-136a1887-f901-4525-890e-1b4d54ba5981 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:54.434678 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-136a1887-f901-4525-890e-1b4d54ba5981 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:54.435465 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-136a1887-f901-4525-890e-1b4d54ba5981 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:54.435920 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-136a1887-f901-4525-890e-1b4d54ba5981 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:54.551952 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-59c9d856-8eb8-475a-9225-3b93625bc832 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:54.559362 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-59c9d856-8eb8-475a-9225-3b93625bc832 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.148687 Apr 11 13:59:54.560406 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 254/508] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:54 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:54.651899 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-81d30fee-8c25-4f70-9248-356e13624b56 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:54.652522 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-81d30fee-8c25-4f70-9248-356e13624b56 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:54.658457 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-81d30fee-8c25-4f70-9248-356e13624b56 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:54.659171 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-81d30fee-8c25-4f70-9248-356e13624b56 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:54.659973 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-81d30fee-8c25-4f70-9248-356e13624b56 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:54.660411 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-81d30fee-8c25-4f70-9248-356e13624b56 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:54.769785 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-136a1887-f901-4525-890e-1b4d54ba5981 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:54.777812 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-136a1887-f901-4525-890e-1b4d54ba5981 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1749 microversion: 2.1 time: 0.354192 Apr 11 13:59:54.787721 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 255/509] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:54 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1749 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:59:54.791997 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-81d30fee-8c25-4f70-9248-356e13624b56 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:54.799418 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-81d30fee-8c25-4f70-9248-356e13624b56 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 200 len: 1318 microversion: 2.1 time: 0.151472 Apr 11 13:59:54.800184 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 255/510] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:54 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:59:55.576551 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-00ec5aee-a50d-4f5a-8e9b-b407f48907f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:55.577167 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-00ec5aee-a50d-4f5a-8e9b-b407f48907f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:55.583466 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00ec5aee-a50d-4f5a-8e9b-b407f48907f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:55.583940 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00ec5aee-a50d-4f5a-8e9b-b407f48907f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:55.584751 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00ec5aee-a50d-4f5a-8e9b-b407f48907f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:55.585184 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00ec5aee-a50d-4f5a-8e9b-b407f48907f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:55.711103 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-00ec5aee-a50d-4f5a-8e9b-b407f48907f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:55.718993 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-00ec5aee-a50d-4f5a-8e9b-b407f48907f0 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.146507 Apr 11 13:59:55.719570 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 256/511] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:55 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:55.795075 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a2143ce9-df7a-4aa4-a29e-f6b60368b057 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:55.795853 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a2143ce9-df7a-4aa4-a29e-f6b60368b057 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:55.802179 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a2143ce9-df7a-4aa4-a29e-f6b60368b057 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:55.802625 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a2143ce9-df7a-4aa4-a29e-f6b60368b057 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:55.803383 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a2143ce9-df7a-4aa4-a29e-f6b60368b057 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:55.803854 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a2143ce9-df7a-4aa4-a29e-f6b60368b057 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:55.816212 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-461058b8-7f85-4d36-bf4a-a723b48a08af tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:55.816925 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-461058b8-7f85-4d36-bf4a-a723b48a08af tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:55.822600 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-461058b8-7f85-4d36-bf4a-a723b48a08af tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:55.823053 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-461058b8-7f85-4d36-bf4a-a723b48a08af tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:55.823855 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-461058b8-7f85-4d36-bf4a-a723b48a08af tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:55.824293 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-461058b8-7f85-4d36-bf4a-a723b48a08af tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:55.943802 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a2143ce9-df7a-4aa4-a29e-f6b60368b057 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:55.951972 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a2143ce9-df7a-4aa4-a29e-f6b60368b057 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.160607 Apr 11 13:59:55.952549 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 256/512] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:55 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:55.955217 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-461058b8-7f85-4d36-bf4a-a723b48a08af tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:55.962299 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-461058b8-7f85-4d36-bf4a-a723b48a08af tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 200 len: 1318 microversion: 2.1 time: 0.149848 Apr 11 13:59:55.962852 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 257/513] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:55 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:59:56.735322 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-aada9df6-9887-4bd8-8f4e-420b2b062f6d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:56.735898 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-aada9df6-9887-4bd8-8f4e-420b2b062f6d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:56.742079 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aada9df6-9887-4bd8-8f4e-420b2b062f6d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:56.742540 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aada9df6-9887-4bd8-8f4e-420b2b062f6d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:56.743583 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aada9df6-9887-4bd8-8f4e-420b2b062f6d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:56.744059 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aada9df6-9887-4bd8-8f4e-420b2b062f6d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:56.872964 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-aada9df6-9887-4bd8-8f4e-420b2b062f6d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:56.880720 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-aada9df6-9887-4bd8-8f4e-420b2b062f6d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.149251 Apr 11 13:59:56.881294 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 257/514] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:56 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:56.969130 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f70acaad-c000-4922-9afb-9958eacc23d1 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:56.969960 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f70acaad-c000-4922-9afb-9958eacc23d1 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:56.978736 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f70acaad-c000-4922-9afb-9958eacc23d1 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:56.979213 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f70acaad-c000-4922-9afb-9958eacc23d1 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:56.979951 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-030945cb-7dd7-4dd2-a2ca-0e7e254e901d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:56.980172 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f70acaad-c000-4922-9afb-9958eacc23d1 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:56.980640 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f70acaad-c000-4922-9afb-9958eacc23d1 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:56.980760 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-030945cb-7dd7-4dd2-a2ca-0e7e254e901d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:56.988669 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-030945cb-7dd7-4dd2-a2ca-0e7e254e901d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:56.989063 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-030945cb-7dd7-4dd2-a2ca-0e7e254e901d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:56.989844 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-030945cb-7dd7-4dd2-a2ca-0e7e254e901d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:56.990289 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-030945cb-7dd7-4dd2-a2ca-0e7e254e901d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:57.134138 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-030945cb-7dd7-4dd2-a2ca-0e7e254e901d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:57.134824 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f70acaad-c000-4922-9afb-9958eacc23d1 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:57.143389 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-030945cb-7dd7-4dd2-a2ca-0e7e254e901d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 200 len: 1318 microversion: 2.1 time: 0.167388 Apr 11 13:59:57.143814 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f70acaad-c000-4922-9afb-9958eacc23d1 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.178376 Apr 11 13:59:57.148727 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 258/515] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:56 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:57.148869 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 258/516] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:56 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:57.149282 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-db91f0bd-9c5d-4a15-8031-dcb1e3012e0c req-7425ae61-5b33-47be-b2fa-5f15c114784b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12dff082-2604-43ab-bc96-80955e79ee1a", "name": "network-vif-plugged", "status": "completed", "tag": "21c45b08-b8bb-4b42-b109-35cb831c8138"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:57.159489 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-db91f0bd-9c5d-4a15-8031-dcb1e3012e0c req-7425ae61-5b33-47be-b2fa-5f15c114784b service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:57.160102 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-db91f0bd-9c5d-4a15-8031-dcb1e3012e0c req-7425ae61-5b33-47be-b2fa-5f15c114784b service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:57.171225 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-db91f0bd-9c5d-4a15-8031-dcb1e3012e0c req-7425ae61-5b33-47be-b2fa-5f15c114784b service nova] Creating event network-vif-plugged:21c45b08-b8bb-4b42-b109-35cb831c8138 for instance 12dff082-2604-43ab-bc96-80955e79ee1a on hv-cinder-83078 Apr 11 13:59:57.176192 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-db91f0bd-9c5d-4a15-8031-dcb1e3012e0c req-7425ae61-5b33-47be-b2fa-5f15c114784b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030336 Apr 11 13:59:57.176780 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 259/517] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 13:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 13:59:57.802783 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-365cb3db-ec52-4fb9-b654-8f46ff497d75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:57.803318 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-365cb3db-ec52-4fb9-b654-8f46ff497d75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:57.809879 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-365cb3db-ec52-4fb9-b654-8f46ff497d75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:57.810338 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-365cb3db-ec52-4fb9-b654-8f46ff497d75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:57.811894 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-365cb3db-ec52-4fb9-b654-8f46ff497d75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:57.812339 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-365cb3db-ec52-4fb9-b654-8f46ff497d75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:57.840492 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-365cb3db-ec52-4fb9-b654-8f46ff497d75 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-volume_attachments/943b494a-1c30-483f-b707-5dc3ed3ffcf8" status: 200 len: 194 microversion: 2.20 time: 0.041825 Apr 11 13:59:57.841068 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 259/518] 10.222.0.67 () {60 vars in 1453 bytes} [Mon Apr 11 13:59:57 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-volume_attachments/943b494a-1c30-483f-b707-5dc3ed3ffcf8 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:59:57.899011 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d87423a6-be1c-49bd-9189-170b992b3250 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:57.899834 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d87423a6-be1c-49bd-9189-170b992b3250 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:57.901790 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1d6e2539-e756-4531-aed8-730e3d5e4596 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:57.902287 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1d6e2539-e756-4531-aed8-730e3d5e4596 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:57.906339 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d87423a6-be1c-49bd-9189-170b992b3250 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:57.906863 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d87423a6-be1c-49bd-9189-170b992b3250 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:57.907736 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d87423a6-be1c-49bd-9189-170b992b3250 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:57.908244 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d87423a6-be1c-49bd-9189-170b992b3250 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:57.908368 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1d6e2539-e756-4531-aed8-730e3d5e4596 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:57.908953 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1d6e2539-e756-4531-aed8-730e3d5e4596 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:57.909712 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1d6e2539-e756-4531-aed8-730e3d5e4596 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:57.910147 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1d6e2539-e756-4531-aed8-730e3d5e4596 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:57.988352 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-1d6e2539-e756-4531-aed8-730e3d5e4596 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lazy-loading 'services' on Instance uuid 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 13:59:58.035540 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d87423a6-be1c-49bd-9189-170b992b3250 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:58.043578 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d87423a6-be1c-49bd-9189-170b992b3250 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.149134 Apr 11 13:59:58.044189 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 260/519] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:57 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:58.061866 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1d6e2539-e756-4531-aed8-730e3d5e4596 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-volume_attachments/943b494a-1c30-483f-b707-5dc3ed3ffcf8" status: 202 len: 0 microversion: 2.20 time: 0.163043 Apr 11 13:59:58.062390 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 260/520] 10.222.0.67 () {60 vars in 1456 bytes} [Mon Apr 11 13:59:57 2022] DELETE /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-volume_attachments/943b494a-1c30-483f-b707-5dc3ed3ffcf8 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 11 13:59:58.070531 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-92db8c7a-99cf-4d78-bc87-be0615d2e8ca tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:58.071491 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-92db8c7a-99cf-4d78-bc87-be0615d2e8ca tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:58.077332 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92db8c7a-99cf-4d78-bc87-be0615d2e8ca tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:58.077784 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92db8c7a-99cf-4d78-bc87-be0615d2e8ca tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:58.078554 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92db8c7a-99cf-4d78-bc87-be0615d2e8ca tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:58.078994 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92db8c7a-99cf-4d78-bc87-be0615d2e8ca tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:58.106388 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-92db8c7a-99cf-4d78-bc87-be0615d2e8ca tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039711 Apr 11 13:59:58.106936 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 261/521] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Apr 11 13:59:58 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 13:59:58.160551 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-802dafc0-2d4b-440e-af14-4254a20dba20 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:58.160935 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cd765e3f-7157-4e01-9d36-708ce6469af7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:58.161205 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-802dafc0-2d4b-440e-af14-4254a20dba20 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:58.161628 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cd765e3f-7157-4e01-9d36-708ce6469af7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:58.167333 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-802dafc0-2d4b-440e-af14-4254a20dba20 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:58.167513 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd765e3f-7157-4e01-9d36-708ce6469af7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:58.167830 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-802dafc0-2d4b-440e-af14-4254a20dba20 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:58.167990 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd765e3f-7157-4e01-9d36-708ce6469af7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:58.168603 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-802dafc0-2d4b-440e-af14-4254a20dba20 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:58.168748 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd765e3f-7157-4e01-9d36-708ce6469af7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:58.169041 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-802dafc0-2d4b-440e-af14-4254a20dba20 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:58.169172 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd765e3f-7157-4e01-9d36-708ce6469af7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:58.300348 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-802dafc0-2d4b-440e-af14-4254a20dba20 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:58.307590 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-802dafc0-2d4b-440e-af14-4254a20dba20 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 200 len: 1318 microversion: 2.1 time: 0.150960 Apr 11 13:59:58.308391 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 262/522] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:58 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:59:58.314126 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cd765e3f-7157-4e01-9d36-708ce6469af7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:58.323502 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cd765e3f-7157-4e01-9d36-708ce6469af7 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.166875 Apr 11 13:59:58.324365 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 261/523] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:58 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:59.062023 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-431e458c-3195-4cd7-b41d-1dec0792a654 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:59.062567 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-431e458c-3195-4cd7-b41d-1dec0792a654 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:59.068810 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-431e458c-3195-4cd7-b41d-1dec0792a654 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:59.069258 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-431e458c-3195-4cd7-b41d-1dec0792a654 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:59.070014 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-431e458c-3195-4cd7-b41d-1dec0792a654 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:59.070445 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-431e458c-3195-4cd7-b41d-1dec0792a654 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:59.118475 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3a880926-e14d-4720-8eaf-4e47aae7a8a1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:59.119571 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3a880926-e14d-4720-8eaf-4e47aae7a8a1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:59.125942 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3a880926-e14d-4720-8eaf-4e47aae7a8a1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:59.126471 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3a880926-e14d-4720-8eaf-4e47aae7a8a1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:59.127253 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3a880926-e14d-4720-8eaf-4e47aae7a8a1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:59.127714 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3a880926-e14d-4720-8eaf-4e47aae7a8a1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:59.157040 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3a880926-e14d-4720-8eaf-4e47aae7a8a1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042454 Apr 11 13:59:59.157621 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 262/524] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Apr 11 13:59:59 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 13:59:59.196117 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-431e458c-3195-4cd7-b41d-1dec0792a654 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:59.203821 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-431e458c-3195-4cd7-b41d-1dec0792a654 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.145664 Apr 11 13:59:59.204395 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 263/525] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:59 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:59.324332 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8e91246d-c625-41f0-b17c-07c1a933df14 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:59.324880 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8e91246d-c625-41f0-b17c-07c1a933df14 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:59.331278 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8e91246d-c625-41f0-b17c-07c1a933df14 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:59.331759 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8e91246d-c625-41f0-b17c-07c1a933df14 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:59.332522 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8e91246d-c625-41f0-b17c-07c1a933df14 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:59.332959 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8e91246d-c625-41f0-b17c-07c1a933df14 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:59.340198 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6feb386b-7973-430f-8ee5-3cf356d1eb0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 13:59:59.340859 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6feb386b-7973-430f-8ee5-3cf356d1eb0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:59.347338 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6feb386b-7973-430f-8ee5-3cf356d1eb0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:59.347851 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6feb386b-7973-430f-8ee5-3cf356d1eb0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:59.348633 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6feb386b-7973-430f-8ee5-3cf356d1eb0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:59.349070 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6feb386b-7973-430f-8ee5-3cf356d1eb0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:59.460219 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8e91246d-c625-41f0-b17c-07c1a933df14 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:59.468174 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8e91246d-c625-41f0-b17c-07c1a933df14 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 200 len: 1506 microversion: 2.1 time: 0.147737 Apr 11 13:59:59.468746 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 263/526] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:59 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 13:59:59.485124 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-58e65f4a-230c-4907-aca0-834d8bec0962 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92fd450c-4dbe-4564-a1f5-316eec0a38db", "device": "/dev/sdb"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 13:59:59.486281 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-58e65f4a-230c-4907-aca0-834d8bec0962 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 13:59:59.491688 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6feb386b-7973-430f-8ee5-3cf356d1eb0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 13:59:59.492016 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-58e65f4a-230c-4907-aca0-834d8bec0962 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:59.492479 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-58e65f4a-230c-4907-aca0-834d8bec0962 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:59.493482 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-58e65f4a-230c-4907-aca0-834d8bec0962 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 13:59:59.493738 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-58e65f4a-230c-4907-aca0-834d8bec0962 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 13:59:59.501190 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6feb386b-7973-430f-8ee5-3cf356d1eb0b tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.164688 Apr 11 13:59:59.501768 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 264/527] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 13:59:59 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 13:59:59.805968 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-58e65f4a-230c-4907-aca0-834d8bec0962 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "POST /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325212 Apr 11 13:59:59.806570 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 264/528] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 13:59:59 2022] POST /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:00:00.169367 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-edbf9746-305c-4b90-a210-f2f91bcb47e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:00.170486 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-edbf9746-305c-4b90-a210-f2f91bcb47e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:00.176767 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-edbf9746-305c-4b90-a210-f2f91bcb47e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:00.177219 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-edbf9746-305c-4b90-a210-f2f91bcb47e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:00.177988 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-edbf9746-305c-4b90-a210-f2f91bcb47e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:00.178423 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-edbf9746-305c-4b90-a210-f2f91bcb47e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:00.206838 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-edbf9746-305c-4b90-a210-f2f91bcb47e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041393 Apr 11 14:00:00.207300 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 265/529] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Apr 11 14:00:00 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:00.222410 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1232414e-6725-4f75-a720-b439505a2104 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:00.223118 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1232414e-6725-4f75-a720-b439505a2104 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:00.229800 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1232414e-6725-4f75-a720-b439505a2104 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:00.230273 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1232414e-6725-4f75-a720-b439505a2104 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:00.231026 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1232414e-6725-4f75-a720-b439505a2104 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:00.231461 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1232414e-6725-4f75-a720-b439505a2104 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:00.264601 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-84f15395-a95b-4be4-9183-4943a45fc06f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:00.265393 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-84f15395-a95b-4be4-9183-4943a45fc06f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:00.271903 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-84f15395-a95b-4be4-9183-4943a45fc06f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:00.272354 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-84f15395-a95b-4be4-9183-4943a45fc06f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:00.273785 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-84f15395-a95b-4be4-9183-4943a45fc06f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:00.274274 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-84f15395-a95b-4be4-9183-4943a45fc06f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:00.300464 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-84f15395-a95b-4be4-9183-4943a45fc06f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:00:00.372047 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1232414e-6725-4f75-a720-b439505a2104 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:00.385645 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1232414e-6725-4f75-a720-b439505a2104 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.168553 Apr 11 14:00:00.386245 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 265/530] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:00 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:00.386389 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-84f15395-a95b-4be4-9183-4943a45fc06f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 204 len: 0 microversion: 2.20 time: 0.125807 Apr 11 14:00:00.387185 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 266/531] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Apr 11 14:00:00 2022] DELETE /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 11 14:00:00.395872 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c5927b48-12e8-4350-92a9-dc1c8bc514ec tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:00.396489 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c5927b48-12e8-4350-92a9-dc1c8bc514ec tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:00.402553 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c5927b48-12e8-4350-92a9-dc1c8bc514ec tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:00.403003 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c5927b48-12e8-4350-92a9-dc1c8bc514ec tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:00.403813 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c5927b48-12e8-4350-92a9-dc1c8bc514ec tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:00.404250 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c5927b48-12e8-4350-92a9-dc1c8bc514ec tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:00.518934 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6b60606a-ec1d-489d-87f4-d8e26aa5e25e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:00.519802 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6b60606a-ec1d-489d-87f4-d8e26aa5e25e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:00.525847 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6b60606a-ec1d-489d-87f4-d8e26aa5e25e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:00.526434 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6b60606a-ec1d-489d-87f4-d8e26aa5e25e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:00.527071 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6b60606a-ec1d-489d-87f4-d8e26aa5e25e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:00.527499 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6b60606a-ec1d-489d-87f4-d8e26aa5e25e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:00.529087 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c5927b48-12e8-4350-92a9-dc1c8bc514ec tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:00.537647 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c5927b48-12e8-4350-92a9-dc1c8bc514ec tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:00.539131 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c5927b48-12e8-4350-92a9-dc1c8bc514ec tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:00.540502 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c5927b48-12e8-4350-92a9-dc1c8bc514ec tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.148993 Apr 11 14:00:00.541072 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 266/532] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:00 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:00:00.665885 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6b60606a-ec1d-489d-87f4-d8e26aa5e25e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:00.674259 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6b60606a-ec1d-489d-87f4-d8e26aa5e25e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.159729 Apr 11 14:00:00.674851 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 267/533] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:00 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:00:01.403223 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b4259a14-dd78-4c8e-b6cc-0c481176f844 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:01.403867 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b4259a14-dd78-4c8e-b6cc-0c481176f844 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:01.411122 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b4259a14-dd78-4c8e-b6cc-0c481176f844 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:01.411569 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b4259a14-dd78-4c8e-b6cc-0c481176f844 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:01.412352 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b4259a14-dd78-4c8e-b6cc-0c481176f844 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:01.412789 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b4259a14-dd78-4c8e-b6cc-0c481176f844 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:01.539890 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b4259a14-dd78-4c8e-b6cc-0c481176f844 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:01.547753 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b4259a14-dd78-4c8e-b6cc-0c481176f844 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.148328 Apr 11 14:00:01.548327 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 267/534] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:01 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:01.559669 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8b83cecc-1b9d-4447-85eb-2331ca4ab525 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:01.560291 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8b83cecc-1b9d-4447-85eb-2331ca4ab525 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:01.566473 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b83cecc-1b9d-4447-85eb-2331ca4ab525 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:01.566922 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b83cecc-1b9d-4447-85eb-2331ca4ab525 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:01.567697 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b83cecc-1b9d-4447-85eb-2331ca4ab525 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:01.568137 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b83cecc-1b9d-4447-85eb-2331ca4ab525 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:01.691523 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-84d4cf95-f145-4bf2-aef0-b3e723fc370d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:01.692035 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-84d4cf95-f145-4bf2-aef0-b3e723fc370d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:01.693782 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8b83cecc-1b9d-4447-85eb-2331ca4ab525 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:01.697820 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-84d4cf95-f145-4bf2-aef0-b3e723fc370d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:01.698268 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-84d4cf95-f145-4bf2-aef0-b3e723fc370d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:01.699043 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-84d4cf95-f145-4bf2-aef0-b3e723fc370d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:01.699477 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-84d4cf95-f145-4bf2-aef0-b3e723fc370d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:01.702276 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8b83cecc-1b9d-4447-85eb-2331ca4ab525 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:01.703792 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8b83cecc-1b9d-4447-85eb-2331ca4ab525 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:01.704951 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8b83cecc-1b9d-4447-85eb-2331ca4ab525 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.149199 Apr 11 14:00:01.705505 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 268/535] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:01 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:01.836983 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-84d4cf95-f145-4bf2-aef0-b3e723fc370d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:01.844832 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-84d4cf95-f145-4bf2-aef0-b3e723fc370d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.157350 Apr 11 14:00:01.845402 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 268/536] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:01 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:00:02.565049 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-19fa8a61-ef66-472a-9ba0-50062ad29099 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:02.565843 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-19fa8a61-ef66-472a-9ba0-50062ad29099 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:02.572113 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19fa8a61-ef66-472a-9ba0-50062ad29099 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:02.572560 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19fa8a61-ef66-472a-9ba0-50062ad29099 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:02.573328 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19fa8a61-ef66-472a-9ba0-50062ad29099 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:02.573760 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19fa8a61-ef66-472a-9ba0-50062ad29099 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:02.701954 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-19fa8a61-ef66-472a-9ba0-50062ad29099 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:02.709148 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-19fa8a61-ef66-472a-9ba0-50062ad29099 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.148235 Apr 11 14:00:02.709730 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 269/537] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:02 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:02.723394 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6cc7020a-344c-486a-9e17-c1bdbb1d6664 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:02.724037 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6cc7020a-344c-486a-9e17-c1bdbb1d6664 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:02.730059 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6cc7020a-344c-486a-9e17-c1bdbb1d6664 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:02.730509 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6cc7020a-344c-486a-9e17-c1bdbb1d6664 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:02.731272 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6cc7020a-344c-486a-9e17-c1bdbb1d6664 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:02.731730 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6cc7020a-344c-486a-9e17-c1bdbb1d6664 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:02.856799 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6cc7020a-344c-486a-9e17-c1bdbb1d6664 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:02.862012 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f94e2f2b-0e7d-4e7b-9bcb-67080394c607 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:02.862655 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f94e2f2b-0e7d-4e7b-9bcb-67080394c607 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:02.864579 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6cc7020a-344c-486a-9e17-c1bdbb1d6664 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:02.866088 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6cc7020a-344c-486a-9e17-c1bdbb1d6664 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:02.867267 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6cc7020a-344c-486a-9e17-c1bdbb1d6664 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.148253 Apr 11 14:00:02.868169 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 269/538] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:02 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:02.868437 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f94e2f2b-0e7d-4e7b-9bcb-67080394c607 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:02.868954 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f94e2f2b-0e7d-4e7b-9bcb-67080394c607 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:02.869725 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f94e2f2b-0e7d-4e7b-9bcb-67080394c607 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:02.870158 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f94e2f2b-0e7d-4e7b-9bcb-67080394c607 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:03.025677 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f94e2f2b-0e7d-4e7b-9bcb-67080394c607 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:03.034182 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f94e2f2b-0e7d-4e7b-9bcb-67080394c607 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.176005 Apr 11 14:00:03.034737 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 270/539] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:02 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:00:03.727457 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-db7f82bb-b81b-4034-bafb-ef8a8acac7d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:03.728109 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-db7f82bb-b81b-4034-bafb-ef8a8acac7d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:03.735371 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-db7f82bb-b81b-4034-bafb-ef8a8acac7d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:03.735858 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-db7f82bb-b81b-4034-bafb-ef8a8acac7d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:03.736641 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-db7f82bb-b81b-4034-bafb-ef8a8acac7d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:03.737085 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-db7f82bb-b81b-4034-bafb-ef8a8acac7d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:03.885405 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fb0d0b70-bdad-445a-93fb-698536b21a2d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:03.886027 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fb0d0b70-bdad-445a-93fb-698536b21a2d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:03.892878 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fb0d0b70-bdad-445a-93fb-698536b21a2d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:03.893380 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fb0d0b70-bdad-445a-93fb-698536b21a2d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:03.894167 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fb0d0b70-bdad-445a-93fb-698536b21a2d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:03.894588 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fb0d0b70-bdad-445a-93fb-698536b21a2d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:03.956111 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-db7f82bb-b81b-4034-bafb-ef8a8acac7d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:03.963511 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-db7f82bb-b81b-4034-bafb-ef8a8acac7d9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.239939 Apr 11 14:00:03.964334 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 270/540] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:03 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:04.025090 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fb0d0b70-bdad-445a-93fb-698536b21a2d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:04.035813 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fb0d0b70-bdad-445a-93fb-698536b21a2d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:04.037822 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fb0d0b70-bdad-445a-93fb-698536b21a2d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:04.039348 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fb0d0b70-bdad-445a-93fb-698536b21a2d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1723 microversion: 2.20 time: 0.157792 Apr 11 14:00:04.040273 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 271/541] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:03 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:00:04.057346 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-651ececa-28fa-4c06-903d-4a3d9bcacc7d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:04.058030 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-651ececa-28fa-4c06-903d-4a3d9bcacc7d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:04.067444 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-651ececa-28fa-4c06-903d-4a3d9bcacc7d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:04.067876 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-651ececa-28fa-4c06-903d-4a3d9bcacc7d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:04.068838 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-651ececa-28fa-4c06-903d-4a3d9bcacc7d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:04.070617 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-651ececa-28fa-4c06-903d-4a3d9bcacc7d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:04.290977 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-651ececa-28fa-4c06-903d-4a3d9bcacc7d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:04.299612 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-651ececa-28fa-4c06-903d-4a3d9bcacc7d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.247330 Apr 11 14:00:04.300165 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 271/542] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:04 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:04.455513 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-e7d2a07c-ea15-4972-9369-1d361bda15f5 req-ed8ab951-8029-4126-9007-3b7a9a9b560f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5f3b7d-8b92-4264-b41a-1d1ade879f2f", "name": "network-vif-deleted", "tag": "cda04f4a-80ef-4c18-b575-cb87293272ce"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:04.465115 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-e7d2a07c-ea15-4972-9369-1d361bda15f5 req-ed8ab951-8029-4126-9007-3b7a9a9b560f service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:04.465564 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-e7d2a07c-ea15-4972-9369-1d361bda15f5 req-ed8ab951-8029-4126-9007-3b7a9a9b560f service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:04.479014 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-e7d2a07c-ea15-4972-9369-1d361bda15f5 req-ed8ab951-8029-4126-9007-3b7a9a9b560f service nova] Creating event network-vif-deleted:cda04f4a-80ef-4c18-b575-cb87293272ce for instance 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f on hv-cinder-83078 Apr 11 14:00:04.485047 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-e7d2a07c-ea15-4972-9369-1d361bda15f5 req-ed8ab951-8029-4126-9007-3b7a9a9b560f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033678 Apr 11 14:00:04.487785 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 272/543] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:00:04.981451 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d8bda195-233a-42b8-a725-7e80d26e1fba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:04.981991 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d8bda195-233a-42b8-a725-7e80d26e1fba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:04.988301 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8bda195-233a-42b8-a725-7e80d26e1fba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:04.988751 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8bda195-233a-42b8-a725-7e80d26e1fba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:04.989609 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8bda195-233a-42b8-a725-7e80d26e1fba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:04.990204 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8bda195-233a-42b8-a725-7e80d26e1fba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:05.059718 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3496b445-17b9-49b7-afe7-5db1d01e0673 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:05.061847 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3496b445-17b9-49b7-afe7-5db1d01e0673 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:05.069718 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3496b445-17b9-49b7-afe7-5db1d01e0673 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:05.069963 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3496b445-17b9-49b7-afe7-5db1d01e0673 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:05.071139 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3496b445-17b9-49b7-afe7-5db1d01e0673 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:05.071851 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3496b445-17b9-49b7-afe7-5db1d01e0673 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:05.132358 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d8bda195-233a-42b8-a725-7e80d26e1fba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:05.140779 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3496b445-17b9-49b7-afe7-5db1d01e0673 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:05.143055 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d8bda195-233a-42b8-a725-7e80d26e1fba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.165619 Apr 11 14:00:05.144234 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 272/544] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:04 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:05.150441 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3496b445-17b9-49b7-afe7-5db1d01e0673 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:05.152674 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3496b445-17b9-49b7-afe7-5db1d01e0673 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:05.154290 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3496b445-17b9-49b7-afe7-5db1d01e0673 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1367 microversion: 2.20 time: 0.099255 Apr 11 14:00:05.155096 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 273/545] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:05 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1367 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:05.316206 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5e4cf4f1-3b30-4369-b049-e0ad5d8ae59e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:05.316825 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5e4cf4f1-3b30-4369-b049-e0ad5d8ae59e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:05.322770 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5e4cf4f1-3b30-4369-b049-e0ad5d8ae59e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:05.323257 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5e4cf4f1-3b30-4369-b049-e0ad5d8ae59e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:05.324096 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5e4cf4f1-3b30-4369-b049-e0ad5d8ae59e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:05.324527 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5e4cf4f1-3b30-4369-b049-e0ad5d8ae59e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:05.481216 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5e4cf4f1-3b30-4369-b049-e0ad5d8ae59e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:05.489975 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5e4cf4f1-3b30-4369-b049-e0ad5d8ae59e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.177802 Apr 11 14:00:05.490874 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 273/546] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:05 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:06.161602 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-addeb88a-fd0f-4af2-8145-fcbce8d746e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:06.162226 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-addeb88a-fd0f-4af2-8145-fcbce8d746e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:06.168691 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-addeb88a-fd0f-4af2-8145-fcbce8d746e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:06.169155 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-addeb88a-fd0f-4af2-8145-fcbce8d746e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:06.170079 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-addeb88a-fd0f-4af2-8145-fcbce8d746e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:06.170543 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-addeb88a-fd0f-4af2-8145-fcbce8d746e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:06.173236 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ad272746-a0a2-4c89-8de5-51cb63898adb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:06.173949 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ad272746-a0a2-4c89-8de5-51cb63898adb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:06.180179 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad272746-a0a2-4c89-8de5-51cb63898adb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:06.180710 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad272746-a0a2-4c89-8de5-51cb63898adb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:06.181559 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad272746-a0a2-4c89-8de5-51cb63898adb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:06.182065 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad272746-a0a2-4c89-8de5-51cb63898adb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:06.244051 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ad272746-a0a2-4c89-8de5-51cb63898adb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:06.252673 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ad272746-a0a2-4c89-8de5-51cb63898adb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:06.254167 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ad272746-a0a2-4c89-8de5-51cb63898adb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:06.255329 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ad272746-a0a2-4c89-8de5-51cb63898adb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1367 microversion: 2.20 time: 0.086372 Apr 11 14:00:06.256141 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 274/547] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:06 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:00:06.309549 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-addeb88a-fd0f-4af2-8145-fcbce8d746e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:06.320956 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-addeb88a-fd0f-4af2-8145-fcbce8d746e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.163387 Apr 11 14:00:06.321539 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 274/548] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:06 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:06.507803 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-190ff688-2a87-4bb6-9c6f-33288f7b1959 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:06.508346 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-190ff688-2a87-4bb6-9c6f-33288f7b1959 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:06.514875 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-190ff688-2a87-4bb6-9c6f-33288f7b1959 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:06.515357 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-190ff688-2a87-4bb6-9c6f-33288f7b1959 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:06.516263 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-190ff688-2a87-4bb6-9c6f-33288f7b1959 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:06.516704 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-190ff688-2a87-4bb6-9c6f-33288f7b1959 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:06.658222 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-190ff688-2a87-4bb6-9c6f-33288f7b1959 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:06.666284 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-190ff688-2a87-4bb6-9c6f-33288f7b1959 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.162566 Apr 11 14:00:06.666871 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 275/549] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:06 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:07.273898 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8d7dffba-1c66-4f76-b1f9-15a0b1b6181a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:07.274528 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8d7dffba-1c66-4f76-b1f9-15a0b1b6181a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:07.282091 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d7dffba-1c66-4f76-b1f9-15a0b1b6181a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:07.282552 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d7dffba-1c66-4f76-b1f9-15a0b1b6181a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:07.283587 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d7dffba-1c66-4f76-b1f9-15a0b1b6181a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:07.284061 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d7dffba-1c66-4f76-b1f9-15a0b1b6181a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:07.315487 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d7dffba-1c66-4f76-b1f9-15a0b1b6181a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:07.315864 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d7dffba-1c66-4f76-b1f9-15a0b1b6181a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:07.316321 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-8d7dffba-1c66-4f76-b1f9-15a0b1b6181a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lazy-loading 'fault' on Instance uuid 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:00:07.338138 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-818c4b65-4cda-4fc9-9cd1-b2c36ebd5edb tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:07.338758 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-818c4b65-4cda-4fc9-9cd1-b2c36ebd5edb tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:07.350813 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-818c4b65-4cda-4fc9-9cd1-b2c36ebd5edb tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:07.351276 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-818c4b65-4cda-4fc9-9cd1-b2c36ebd5edb tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:07.352291 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-818c4b65-4cda-4fc9-9cd1-b2c36ebd5edb tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:07.352735 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-818c4b65-4cda-4fc9-9cd1-b2c36ebd5edb tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:07.380651 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8d7dffba-1c66-4f76-b1f9-15a0b1b6181a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:07.392455 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8d7dffba-1c66-4f76-b1f9-15a0b1b6181a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:07.397532 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8d7dffba-1c66-4f76-b1f9-15a0b1b6181a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:07.398829 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8d7dffba-1c66-4f76-b1f9-15a0b1b6181a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 200 len: 1372 microversion: 2.20 time: 0.128807 Apr 11 14:00:07.399417 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 275/550] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:07 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 1372 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:07.504172 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-818c4b65-4cda-4fc9-9cd1-b2c36ebd5edb tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:07.511985 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-818c4b65-4cda-4fc9-9cd1-b2c36ebd5edb tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1677 microversion: 2.1 time: 0.177696 Apr 11 14:00:07.512549 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 276/551] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:07 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:07.684529 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cf36b366-7f4a-413e-bc32-ecbc2f8f69df tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:07.685244 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cf36b366-7f4a-413e-bc32-ecbc2f8f69df tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:07.691908 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf36b366-7f4a-413e-bc32-ecbc2f8f69df tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:07.692375 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf36b366-7f4a-413e-bc32-ecbc2f8f69df tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:07.693249 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf36b366-7f4a-413e-bc32-ecbc2f8f69df tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:07.693993 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf36b366-7f4a-413e-bc32-ecbc2f8f69df tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:07.847724 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cf36b366-7f4a-413e-bc32-ecbc2f8f69df tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:07.855851 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cf36b366-7f4a-413e-bc32-ecbc2f8f69df tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.175806 Apr 11 14:00:07.856537 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 276/552] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:07 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:00:08.419881 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-290c1ac8-a948-40ff-bdb0-60959140f7e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:08.420598 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-290c1ac8-a948-40ff-bdb0-60959140f7e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:08.426779 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-290c1ac8-a948-40ff-bdb0-60959140f7e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:08.427230 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-290c1ac8-a948-40ff-bdb0-60959140f7e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:08.428029 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-290c1ac8-a948-40ff-bdb0-60959140f7e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:08.428469 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-290c1ac8-a948-40ff-bdb0-60959140f7e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:08.442451 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-290c1ac8-a948-40ff-bdb0-60959140f7e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] HTTP exception thrown: Instance 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f could not be found. Apr 11 14:00:08.443024 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-290c1ac8-a948-40ff-bdb0-60959140f7e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Returning 404 to user: Instance 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:00:08.443939 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-290c1ac8-a948-40ff-bdb0-60959140f7e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 404 len: 111 microversion: 2.20 time: 0.027987 Apr 11 14:00:08.444539 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 277/553] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:08 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 14:00:08.454806 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4530ef9a-c407-46a6-8916-16f3249485b7 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '.version_select at 0x7f73069524c0>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:08.474386 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4530ef9a-c407-46a6-8916-16f3249485b7 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738121521" status: 204 len: 0 microversion: 2.20 time: 0.024502 Apr 11 14:00:08.475070 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 277/554] 10.222.0.67 () {60 vars in 1261 bytes} [Mon Apr 11 14:00:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738121521 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 14:00:08.529520 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2691003f-e382-4974-b2ae-8906f2f8465b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:08.530222 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2691003f-e382-4974-b2ae-8906f2f8465b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:08.537834 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2691003f-e382-4974-b2ae-8906f2f8465b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:08.538290 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2691003f-e382-4974-b2ae-8906f2f8465b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:08.539061 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2691003f-e382-4974-b2ae-8906f2f8465b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:08.544555 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2691003f-e382-4974-b2ae-8906f2f8465b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:08.678116 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2691003f-e382-4974-b2ae-8906f2f8465b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:08.688406 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2691003f-e382-4974-b2ae-8906f2f8465b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1654 microversion: 2.1 time: 0.163419 Apr 11 14:00:08.689123 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 278/555] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:08 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1654 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:08.704753 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3d0dbc32-1058-4535-8cd5-dc8815e965cb tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:08.711489 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d0dbc32-1058-4535-8cd5-dc8815e965cb tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:08.711984 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d0dbc32-1058-4535-8cd5-dc8815e965cb tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:08.733994 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3d0dbc32-1058-4535-8cd5-dc8815e965cb tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Going to try to start instance {{(pid=116941) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 11 14:00:08.775336 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3d0dbc32-1058-4535-8cd5-dc8815e965cb tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "POST /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/action" status: 202 len: 0 microversion: 2.1 time: 0.074171 Apr 11 14:00:08.775855 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 278/556] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 14:00:08 2022] POST /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:00:08.785025 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ac0fb359-4558-4823-af78-0f1d72637b29 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:08.785650 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ac0fb359-4558-4823-af78-0f1d72637b29 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:08.792355 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac0fb359-4558-4823-af78-0f1d72637b29 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:08.792841 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac0fb359-4558-4823-af78-0f1d72637b29 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:08.793664 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac0fb359-4558-4823-af78-0f1d72637b29 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:08.795556 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac0fb359-4558-4823-af78-0f1d72637b29 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:08.874790 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8610544c-96b9-42e2-b71d-4f76358b52bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:08.875549 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8610544c-96b9-42e2-b71d-4f76358b52bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:08.881504 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8610544c-96b9-42e2-b71d-4f76358b52bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:08.881957 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8610544c-96b9-42e2-b71d-4f76358b52bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:08.882739 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8610544c-96b9-42e2-b71d-4f76358b52bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:08.883173 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8610544c-96b9-42e2-b71d-4f76358b52bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:09.029156 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ac0fb359-4558-4823-af78-0f1d72637b29 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:09.032237 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8610544c-96b9-42e2-b71d-4f76358b52bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:09.036909 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ac0fb359-4558-4823-af78-0f1d72637b29 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1663 microversion: 2.1 time: 0.256140 Apr 11 14:00:09.037629 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 279/557] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:08 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1663 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:09.040946 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8610544c-96b9-42e2-b71d-4f76358b52bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.170929 Apr 11 14:00:09.041770 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 279/558] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:08 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:00:09.202166 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6297c91a-ce60-490b-8c3e-5a2124f5444a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Action: 'create', calling method: .version_select at 0x7f7306b309d0>, body: {"keypair": {"name": "tempest-keypair-474357988"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:09.216003 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-6297c91a-ce60-490b-8c3e-5a2124f5444a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Getting quotas for project a8a28d94e79a4972b0f8f61ab1cb1490. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:00:09.219909 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-6297c91a-ce60-490b-8c3e-5a2124f5444a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Getting quotas for user 539174103f414528829d033481b83b0d and project a8a28d94e79a4972b0f8f61ab1cb1490. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:00:09.584120 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-6297c91a-ce60-490b-8c3e-5a2124f5444a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Getting quotas for project a8a28d94e79a4972b0f8f61ab1cb1490. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:00:09.587759 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-6297c91a-ce60-490b-8c3e-5a2124f5444a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Getting quotas for user 539174103f414528829d033481b83b0d and project a8a28d94e79a4972b0f8f61ab1cb1490. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:00:09.601077 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6297c91a-ce60-490b-8c3e-5a2124f5444a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.402748 Apr 11 14:00:09.601727 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 280/559] 10.222.0.67 () {62 vars in 1198 bytes} [Mon Apr 11 14:00:09 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 404 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 11 14:00:10.054892 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-23e98410-71bc-4476-a323-2e7859d3acbf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:10.055512 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-23e98410-71bc-4476-a323-2e7859d3acbf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:10.059115 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f360ce2e-4363-4337-bc75-2faa1866c176 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:10.059868 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f360ce2e-4363-4337-bc75-2faa1866c176 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:10.062038 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-23e98410-71bc-4476-a323-2e7859d3acbf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:10.062502 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-23e98410-71bc-4476-a323-2e7859d3acbf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:10.063650 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-23e98410-71bc-4476-a323-2e7859d3acbf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:10.063772 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-23e98410-71bc-4476-a323-2e7859d3acbf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:10.066920 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f360ce2e-4363-4337-bc75-2faa1866c176 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:10.067474 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f360ce2e-4363-4337-bc75-2faa1866c176 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:10.069038 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f360ce2e-4363-4337-bc75-2faa1866c176 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:10.069038 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f360ce2e-4363-4337-bc75-2faa1866c176 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:10.198367 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-23e98410-71bc-4476-a323-2e7859d3acbf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:10.206202 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-23e98410-71bc-4476-a323-2e7859d3acbf tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1663 microversion: 2.1 time: 0.155178 Apr 11 14:00:10.206970 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 280/560] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:10 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:10.297521 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f360ce2e-4363-4337-bc75-2faa1866c176 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:10.305575 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f360ce2e-4363-4337-bc75-2faa1866c176 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.251442 Apr 11 14:00:10.306164 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 281/561] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:10 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:00:10.853572 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1423641947", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0208f136-78bf-40a4-90c8-9a7151bfb362"}], "security_groups": [{"name": "tempest-securitygroup--1214186602"}], "key_name": "tempest-keypair-474357988", "user_data": "}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:10.951531 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] validate_networks() for [('0208f136-78bf-40a4-90c8-9a7151bfb362', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 14:00:11.223285 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-43f059bf-294a-458d-a41a-ed70d549ef08 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:11.223950 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-43f059bf-294a-458d-a41a-ed70d549ef08 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:11.230292 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-43f059bf-294a-458d-a41a-ed70d549ef08 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:11.230746 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-43f059bf-294a-458d-a41a-ed70d549ef08 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:11.232174 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-43f059bf-294a-458d-a41a-ed70d549ef08 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:11.232616 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-43f059bf-294a-458d-a41a-ed70d549ef08 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:11.306154 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 14:00:11.307098 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 14:00:11.307606 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 14:00:11.308039 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 14:00:11.308452 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 14:00:11.317623 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:11.318162 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:11.319040 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:11.319548 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:11.336995 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Getting quotas for project a8a28d94e79a4972b0f8f61ab1cb1490. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:00:11.341697 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Getting quotas for user 539174103f414528829d033481b83b0d and project a8a28d94e79a4972b0f8f61ab1cb1490. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:00:11.352548 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 14:00:11.354869 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 14:00:11.361368 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-43f059bf-294a-458d-a41a-ed70d549ef08 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:11.368617 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-43f059bf-294a-458d-a41a-ed70d549ef08 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1663 microversion: 2.1 time: 0.149136 Apr 11 14:00:11.369181 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 282/562] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:11 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:00:11.374460 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1bfea4b2-d67f-4241-9885-f5fb2a305097 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:11.375189 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1bfea4b2-d67f-4241-9885-f5fb2a305097 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:11.405972 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1bfea4b2-d67f-4241-9885-f5fb2a305097 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:11.406469 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1bfea4b2-d67f-4241-9885-f5fb2a305097 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:11.407285 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1bfea4b2-d67f-4241-9885-f5fb2a305097 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:11.408063 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1bfea4b2-d67f-4241-9885-f5fb2a305097 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:11.417648 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6f366912-8ff8-4e3d-85df-23d2c6c5ee45 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.568294 Apr 11 14:00:11.418925 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 281/563] 10.222.0.67 () {62 vars in 1187 bytes} [Mon Apr 11 14:00:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 11 14:00:11.429239 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5f1788d1-38f7-4b1a-a62b-45c618e1a734 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:11.429968 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5f1788d1-38f7-4b1a-a62b-45c618e1a734 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:11.487730 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5f1788d1-38f7-4b1a-a62b-45c618e1a734 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:11.495368 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5f1788d1-38f7-4b1a-a62b-45c618e1a734 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:11.496952 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5f1788d1-38f7-4b1a-a62b-45c618e1a734 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:11.505694 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5f1788d1-38f7-4b1a-a62b-45c618e1a734 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1281 microversion: 2.20 time: 0.079327 Apr 11 14:00:11.515766 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 282/564] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:11 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:00:11.672431 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1bfea4b2-d67f-4241-9885-f5fb2a305097 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:11.691165 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1bfea4b2-d67f-4241-9885-f5fb2a305097 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.320651 Apr 11 14:00:11.691797 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 283/565] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:11 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:12.386168 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e3119859-925c-422f-8c2e-8bc51336e369 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:12.386775 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e3119859-925c-422f-8c2e-8bc51336e369 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:12.395318 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e3119859-925c-422f-8c2e-8bc51336e369 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:12.395815 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e3119859-925c-422f-8c2e-8bc51336e369 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:12.396607 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e3119859-925c-422f-8c2e-8bc51336e369 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:12.397053 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e3119859-925c-422f-8c2e-8bc51336e369 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:12.524179 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-28f9cec7-2f1d-4b90-8f14-8e701aa8de2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:12.525599 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-28f9cec7-2f1d-4b90-8f14-8e701aa8de2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:12.534004 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-28f9cec7-2f1d-4b90-8f14-8e701aa8de2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:12.537775 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e3119859-925c-422f-8c2e-8bc51336e369 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:12.544737 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-28f9cec7-2f1d-4b90-8f14-8e701aa8de2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:12.545870 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-28f9cec7-2f1d-4b90-8f14-8e701aa8de2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:12.546472 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-28f9cec7-2f1d-4b90-8f14-8e701aa8de2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:12.549009 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e3119859-925c-422f-8c2e-8bc51336e369 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1663 microversion: 2.1 time: 0.166327 Apr 11 14:00:12.550378 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 283/566] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:12 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:12.629504 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-28f9cec7-2f1d-4b90-8f14-8e701aa8de2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:12.638294 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-28f9cec7-2f1d-4b90-8f14-8e701aa8de2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:12.640026 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-28f9cec7-2f1d-4b90-8f14-8e701aa8de2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:12.641139 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-28f9cec7-2f1d-4b90-8f14-8e701aa8de2a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1351 microversion: 2.20 time: 0.121393 Apr 11 14:00:12.641696 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 284/567] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:12 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:12.708929 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-003e14f0-31fd-402b-9534-cad986efd1a3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:12.709562 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-003e14f0-31fd-402b-9534-cad986efd1a3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:12.715437 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-003e14f0-31fd-402b-9534-cad986efd1a3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:12.716086 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-003e14f0-31fd-402b-9534-cad986efd1a3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:12.717116 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-003e14f0-31fd-402b-9534-cad986efd1a3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:12.717626 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-003e14f0-31fd-402b-9534-cad986efd1a3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:12.887247 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-003e14f0-31fd-402b-9534-cad986efd1a3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:12.896854 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-003e14f0-31fd-402b-9534-cad986efd1a3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.191540 Apr 11 14:00:12.897450 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 284/568] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:12 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:13.566299 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-65cd6a88-e393-4374-9161-197fd1156ffd tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:13.566920 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-65cd6a88-e393-4374-9161-197fd1156ffd tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:13.573305 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-65cd6a88-e393-4374-9161-197fd1156ffd tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:13.573991 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-65cd6a88-e393-4374-9161-197fd1156ffd tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:13.574780 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-65cd6a88-e393-4374-9161-197fd1156ffd tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:13.575802 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-65cd6a88-e393-4374-9161-197fd1156ffd tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:13.659036 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c937e4b9-9e76-428d-98cc-5100fb9dd1cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:13.659684 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c937e4b9-9e76-428d-98cc-5100fb9dd1cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:13.665946 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c937e4b9-9e76-428d-98cc-5100fb9dd1cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:13.666412 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c937e4b9-9e76-428d-98cc-5100fb9dd1cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:13.667191 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c937e4b9-9e76-428d-98cc-5100fb9dd1cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:13.667837 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c937e4b9-9e76-428d-98cc-5100fb9dd1cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:13.784717 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-65cd6a88-e393-4374-9161-197fd1156ffd tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:13.793206 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-65cd6a88-e393-4374-9161-197fd1156ffd tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1667 microversion: 2.1 time: 0.230662 Apr 11 14:00:13.794302 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 285/569] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:13 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1667 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:13.805348 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c937e4b9-9e76-428d-98cc-5100fb9dd1cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:13.814069 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c937e4b9-9e76-428d-98cc-5100fb9dd1cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:13.815779 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c937e4b9-9e76-428d-98cc-5100fb9dd1cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:13.816976 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c937e4b9-9e76-428d-98cc-5100fb9dd1cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1407 microversion: 2.20 time: 0.162241 Apr 11 14:00:13.817616 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 285/570] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:13 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:13.914287 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-51daf222-2320-4fa9-bce8-f95fa29a4b6e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:13.914960 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-51daf222-2320-4fa9-bce8-f95fa29a4b6e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:13.922296 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-51daf222-2320-4fa9-bce8-f95fa29a4b6e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:13.923860 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-51daf222-2320-4fa9-bce8-f95fa29a4b6e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:13.924671 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-51daf222-2320-4fa9-bce8-f95fa29a4b6e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:13.925119 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-51daf222-2320-4fa9-bce8-f95fa29a4b6e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:14.135058 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-51daf222-2320-4fa9-bce8-f95fa29a4b6e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:14.143715 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-51daf222-2320-4fa9-bce8-f95fa29a4b6e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.233215 Apr 11 14:00:14.144347 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 286/571] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:13 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:14.199752 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-06bfa9e6-905b-4893-82a3-7a963f32eb10 req-4b415d0f-bd52-4b9a-91f7-233d2c631fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf497683-01c3-4106-adb0-36d23d564607", "tag": "9c6a342b-a134-4ab5-996e-3eab3c406817"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:14.211348 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-06bfa9e6-905b-4893-82a3-7a963f32eb10 req-4b415d0f-bd52-4b9a-91f7-233d2c631fc2 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:14.212080 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-06bfa9e6-905b-4893-82a3-7a963f32eb10 req-4b415d0f-bd52-4b9a-91f7-233d2c631fc2 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:14.226221 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-06bfa9e6-905b-4893-82a3-7a963f32eb10 req-4b415d0f-bd52-4b9a-91f7-233d2c631fc2 service nova] Creating event network-changed:9c6a342b-a134-4ab5-996e-3eab3c406817 for instance cf497683-01c3-4106-adb0-36d23d564607 on hv-cinder-83078 Apr 11 14:00:14.231301 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-06bfa9e6-905b-4893-82a3-7a963f32eb10 req-4b415d0f-bd52-4b9a-91f7-233d2c631fc2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035166 Apr 11 14:00:14.231992 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 286/572] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:00:14.835117 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-80a197b3-428c-4299-8c99-b411e93a54f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:14.835808 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-80a197b3-428c-4299-8c99-b411e93a54f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:14.842462 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80a197b3-428c-4299-8c99-b411e93a54f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:14.842914 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80a197b3-428c-4299-8c99-b411e93a54f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:14.843707 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80a197b3-428c-4299-8c99-b411e93a54f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:14.844147 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80a197b3-428c-4299-8c99-b411e93a54f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:14.973646 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-80a197b3-428c-4299-8c99-b411e93a54f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:14.981576 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-80a197b3-428c-4299-8c99-b411e93a54f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:14.983087 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-80a197b3-428c-4299-8c99-b411e93a54f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:14.984234 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-80a197b3-428c-4299-8c99-b411e93a54f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1407 microversion: 2.20 time: 0.153141 Apr 11 14:00:14.984804 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 287/573] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:14 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:15.016896 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-52aed5c3-5576-4547-9221-28343861e91c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:15.017477 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-52aed5c3-5576-4547-9221-28343861e91c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:15.023557 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52aed5c3-5576-4547-9221-28343861e91c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:15.024031 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52aed5c3-5576-4547-9221-28343861e91c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:15.024792 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52aed5c3-5576-4547-9221-28343861e91c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:15.025256 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52aed5c3-5576-4547-9221-28343861e91c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:15.100612 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-52aed5c3-5576-4547-9221-28343861e91c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lazy-loading 'services' on Instance uuid 12dff082-2604-43ab-bc96-80955e79ee1a {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:00:15.162723 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-123d94f7-e4fc-4426-8461-ae6209487b1e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:15.163451 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-123d94f7-e4fc-4426-8461-ae6209487b1e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:15.170716 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-123d94f7-e4fc-4426-8461-ae6209487b1e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:15.171173 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-123d94f7-e4fc-4426-8461-ae6209487b1e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:15.171993 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-123d94f7-e4fc-4426-8461-ae6209487b1e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:15.172105 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-52aed5c3-5576-4547-9221-28343861e91c tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "DELETE /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a/os-volume_attachments/92fd450c-4dbe-4564-a1f5-316eec0a38db" status: 202 len: 0 microversion: 2.1 time: 0.160171 Apr 11 14:00:15.172434 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-123d94f7-e4fc-4426-8461-ae6209487b1e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:15.172807 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 287/574] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Apr 11 14:00:15 2022] DELETE /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a/os-volume_attachments/92fd450c-4dbe-4564-a1f5-316eec0a38db => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:00:15.311622 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-123d94f7-e4fc-4426-8461-ae6209487b1e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:15.319305 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-123d94f7-e4fc-4426-8461-ae6209487b1e tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.160760 Apr 11 14:00:15.319904 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 288/575] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:15 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:00:16.002970 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-41a61991-9c07-4469-a762-039df1a28088 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:16.003607 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-41a61991-9c07-4469-a762-039df1a28088 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:16.009781 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-41a61991-9c07-4469-a762-039df1a28088 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:16.010238 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-41a61991-9c07-4469-a762-039df1a28088 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:16.011012 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-41a61991-9c07-4469-a762-039df1a28088 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:16.011467 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-41a61991-9c07-4469-a762-039df1a28088 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:16.138659 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-41a61991-9c07-4469-a762-039df1a28088 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:16.146595 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-41a61991-9c07-4469-a762-039df1a28088 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:16.148138 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-41a61991-9c07-4469-a762-039df1a28088 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:16.149260 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-41a61991-9c07-4469-a762-039df1a28088 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1407 microversion: 2.20 time: 0.150881 Apr 11 14:00:16.149951 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 288/576] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:15 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:00:16.336772 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1da11981-9812-4b74-91b9-4c38645de3c6 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:16.337464 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1da11981-9812-4b74-91b9-4c38645de3c6 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:16.344011 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1da11981-9812-4b74-91b9-4c38645de3c6 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:16.344465 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1da11981-9812-4b74-91b9-4c38645de3c6 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:16.345254 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1da11981-9812-4b74-91b9-4c38645de3c6 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:16.345759 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1da11981-9812-4b74-91b9-4c38645de3c6 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:16.584050 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1da11981-9812-4b74-91b9-4c38645de3c6 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:16.592714 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1da11981-9812-4b74-91b9-4c38645de3c6 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.259811 Apr 11 14:00:16.593318 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 289/577] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:16 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:17.168475 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0151eab2-34f9-457d-89a9-86aab375471e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:17.169134 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0151eab2-34f9-457d-89a9-86aab375471e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:17.174972 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0151eab2-34f9-457d-89a9-86aab375471e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:17.175421 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0151eab2-34f9-457d-89a9-86aab375471e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:17.176214 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0151eab2-34f9-457d-89a9-86aab375471e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:17.176656 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0151eab2-34f9-457d-89a9-86aab375471e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:17.300651 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0151eab2-34f9-457d-89a9-86aab375471e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:17.308520 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0151eab2-34f9-457d-89a9-86aab375471e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:17.310525 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0151eab2-34f9-457d-89a9-86aab375471e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:17.311682 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0151eab2-34f9-457d-89a9-86aab375471e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1407 microversion: 2.20 time: 0.147303 Apr 11 14:00:17.312254 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 289/578] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:17 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:17.331549 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-99452e6b-1663-49c4-8163-ad56a1742a4d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:17.332077 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-99452e6b-1663-49c4-8163-ad56a1742a4d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:17.337868 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-99452e6b-1663-49c4-8163-ad56a1742a4d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:17.338421 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-99452e6b-1663-49c4-8163-ad56a1742a4d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:17.339074 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-99452e6b-1663-49c4-8163-ad56a1742a4d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:17.339518 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-99452e6b-1663-49c4-8163-ad56a1742a4d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:17.363861 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-99452e6b-1663-49c4-8163-ad56a1742a4d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:00:17.441795 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-99452e6b-1663-49c4-8163-ad56a1742a4d tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "DELETE /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 204 len: 0 microversion: 2.1 time: 0.113723 Apr 11 14:00:17.442467 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 290/579] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:00:17 2022] DELETE /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:00:17.451132 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bb1ad74a-beef-45cf-a57a-cd3f7a9f7979 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:17.451977 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bb1ad74a-beef-45cf-a57a-cd3f7a9f7979 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:17.457887 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bb1ad74a-beef-45cf-a57a-cd3f7a9f7979 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:17.458417 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bb1ad74a-beef-45cf-a57a-cd3f7a9f7979 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:17.459263 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bb1ad74a-beef-45cf-a57a-cd3f7a9f7979 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:17.459867 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bb1ad74a-beef-45cf-a57a-cd3f7a9f7979 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:17.595704 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-bb1ad74a-beef-45cf-a57a-cd3f7a9f7979 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:17.603379 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bb1ad74a-beef-45cf-a57a-cd3f7a9f7979 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 200 len: 1512 microversion: 2.1 time: 0.156591 Apr 11 14:00:17.613621 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 290/580] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:17 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:17.613817 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a5397c63-a8b7-489b-b3ad-bba86e7515e8 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:17.613817 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a5397c63-a8b7-489b-b3ad-bba86e7515e8 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:17.618049 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5397c63-a8b7-489b-b3ad-bba86e7515e8 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:17.618507 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5397c63-a8b7-489b-b3ad-bba86e7515e8 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:17.619278 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5397c63-a8b7-489b-b3ad-bba86e7515e8 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:17.619744 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5397c63-a8b7-489b-b3ad-bba86e7515e8 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:17.764827 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a5397c63-a8b7-489b-b3ad-bba86e7515e8 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:17.772536 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a5397c63-a8b7-489b-b3ad-bba86e7515e8 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.166356 Apr 11 14:00:17.773117 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 291/581] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:17 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:18.088348 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-45d58731-4d85-422c-a6d0-6e1bd2b8d460 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:18.088843 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-45d58731-4d85-422c-a6d0-6e1bd2b8d460 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:18.095469 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-45d58731-4d85-422c-a6d0-6e1bd2b8d460 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:18.095951 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-45d58731-4d85-422c-a6d0-6e1bd2b8d460 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:18.096714 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-45d58731-4d85-422c-a6d0-6e1bd2b8d460 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:18.097433 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-45d58731-4d85-422c-a6d0-6e1bd2b8d460 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:18.174174 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-45d58731-4d85-422c-a6d0-6e1bd2b8d460 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lazy-loading 'services' on Instance uuid a1b122bc-5193-4642-9f21-0e30c573c88e {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:00:18.241696 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-45d58731-4d85-422c-a6d0-6e1bd2b8d460 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments/bba0bb7d-357b-4178-9762-fbd709ee3cb7" status: 202 len: 0 microversion: 2.1 time: 0.156995 Apr 11 14:00:18.242290 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 291/582] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Apr 11 14:00:18 2022] DELETE /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments/bba0bb7d-357b-4178-9762-fbd709ee3cb7 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:00:18.250560 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5083f1e3-1d7b-41af-81ea-de3749490b47 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:18.251546 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5083f1e3-1d7b-41af-81ea-de3749490b47 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:18.257410 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5083f1e3-1d7b-41af-81ea-de3749490b47 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:18.257854 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5083f1e3-1d7b-41af-81ea-de3749490b47 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:18.258618 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5083f1e3-1d7b-41af-81ea-de3749490b47 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:18.259051 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5083f1e3-1d7b-41af-81ea-de3749490b47 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:18.287948 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5083f1e3-1d7b-41af-81ea-de3749490b47 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041223 Apr 11 14:00:18.288429 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 292/583] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:00:18 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:00:18.329684 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-27f3800f-2d3a-4b88-931c-b683c691a2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:18.330396 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-27f3800f-2d3a-4b88-931c-b683c691a2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:18.336525 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-27f3800f-2d3a-4b88-931c-b683c691a2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:18.336978 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-27f3800f-2d3a-4b88-931c-b683c691a2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:18.337776 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-27f3800f-2d3a-4b88-931c-b683c691a2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:18.338220 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-27f3800f-2d3a-4b88-931c-b683c691a2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:18.464006 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-27f3800f-2d3a-4b88-931c-b683c691a2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:18.472346 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-27f3800f-2d3a-4b88-931c-b683c691a2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:18.473922 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-27f3800f-2d3a-4b88-931c-b683c691a2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:18.475038 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-27f3800f-2d3a-4b88-931c-b683c691a2f0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1407 microversion: 2.20 time: 0.150103 Apr 11 14:00:18.475874 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 292/584] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:18 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:00:18.621237 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-461b24fe-1228-495b-a8c9-f50f8b217f1f tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:18.622257 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-461b24fe-1228-495b-a8c9-f50f8b217f1f tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:18.628691 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-461b24fe-1228-495b-a8c9-f50f8b217f1f tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:18.629142 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-461b24fe-1228-495b-a8c9-f50f8b217f1f tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:18.629900 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-461b24fe-1228-495b-a8c9-f50f8b217f1f tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:18.630361 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-461b24fe-1228-495b-a8c9-f50f8b217f1f tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:18.758837 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-461b24fe-1228-495b-a8c9-f50f8b217f1f tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:18.766890 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-461b24fe-1228-495b-a8c9-f50f8b217f1f tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 200 len: 1512 microversion: 2.1 time: 0.149565 Apr 11 14:00:18.767453 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 293/585] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:18 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:18.790130 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bdc3a25f-0132-432f-9e48-9aec23da7907 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:18.790747 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bdc3a25f-0132-432f-9e48-9aec23da7907 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:18.796538 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bdc3a25f-0132-432f-9e48-9aec23da7907 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:18.796998 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bdc3a25f-0132-432f-9e48-9aec23da7907 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:18.797764 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bdc3a25f-0132-432f-9e48-9aec23da7907 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:18.798201 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bdc3a25f-0132-432f-9e48-9aec23da7907 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:18.937446 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-bdc3a25f-0132-432f-9e48-9aec23da7907 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:18.945166 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bdc3a25f-0132-432f-9e48-9aec23da7907 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1754 microversion: 2.1 time: 0.158812 Apr 11 14:00:18.945727 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 293/586] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:18 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:19.300433 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-88dee0f0-293f-43fa-a508-985bda0b9cd5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:19.301389 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-88dee0f0-293f-43fa-a508-985bda0b9cd5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:19.307566 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88dee0f0-293f-43fa-a508-985bda0b9cd5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:19.308050 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88dee0f0-293f-43fa-a508-985bda0b9cd5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:19.308835 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88dee0f0-293f-43fa-a508-985bda0b9cd5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:19.309298 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88dee0f0-293f-43fa-a508-985bda0b9cd5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:19.337362 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-88dee0f0-293f-43fa-a508-985bda0b9cd5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040889 Apr 11 14:00:19.337931 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 294/587] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:00:19 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:00:19.493368 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0fb2c618-5b42-4483-9e13-000fa4f66932 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:19.493981 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0fb2c618-5b42-4483-9e13-000fa4f66932 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:19.500374 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0fb2c618-5b42-4483-9e13-000fa4f66932 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:19.500824 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0fb2c618-5b42-4483-9e13-000fa4f66932 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:19.502318 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0fb2c618-5b42-4483-9e13-000fa4f66932 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:19.502503 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0fb2c618-5b42-4483-9e13-000fa4f66932 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:19.561142 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-1406ebdd-24d5-4d33-8ad6-9be8ef375406 req-0a29f6f2-bef5-4ea3-9f36-ae6798af8119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf497683-01c3-4106-adb0-36d23d564607", "name": "network-vif-plugged", "status": "completed", "tag": "9c6a342b-a134-4ab5-996e-3eab3c406817"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:19.569238 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-1406ebdd-24d5-4d33-8ad6-9be8ef375406 req-0a29f6f2-bef5-4ea3-9f36-ae6798af8119 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:19.569733 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-1406ebdd-24d5-4d33-8ad6-9be8ef375406 req-0a29f6f2-bef5-4ea3-9f36-ae6798af8119 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:19.581560 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-1406ebdd-24d5-4d33-8ad6-9be8ef375406 req-0a29f6f2-bef5-4ea3-9f36-ae6798af8119 service nova] Creating event network-vif-plugged:9c6a342b-a134-4ab5-996e-3eab3c406817 for instance cf497683-01c3-4106-adb0-36d23d564607 on hv-cinder-83078 Apr 11 14:00:19.586282 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-1406ebdd-24d5-4d33-8ad6-9be8ef375406 req-0a29f6f2-bef5-4ea3-9f36-ae6798af8119 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028991 Apr 11 14:00:19.587106 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 295/588] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:00:19.632670 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0fb2c618-5b42-4483-9e13-000fa4f66932 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:19.641208 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0fb2c618-5b42-4483-9e13-000fa4f66932 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:19.642755 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0fb2c618-5b42-4483-9e13-000fa4f66932 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:19.643901 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0fb2c618-5b42-4483-9e13-000fa4f66932 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1407 microversion: 2.20 time: 0.154427 Apr 11 14:00:19.644542 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 294/589] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:19 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:19.786181 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-35b13520-16a1-49c5-bd32-81c475013246 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:19.786891 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-35b13520-16a1-49c5-bd32-81c475013246 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:19.792984 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35b13520-16a1-49c5-bd32-81c475013246 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:19.793646 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35b13520-16a1-49c5-bd32-81c475013246 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:19.794572 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35b13520-16a1-49c5-bd32-81c475013246 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:19.794969 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35b13520-16a1-49c5-bd32-81c475013246 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:19.922729 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-35b13520-16a1-49c5-bd32-81c475013246 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:19.930054 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-35b13520-16a1-49c5-bd32-81c475013246 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 200 len: 1512 microversion: 2.1 time: 0.148747 Apr 11 14:00:19.930626 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 296/590] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:19 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:19.961990 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-66f1c9f4-0ca9-49fe-b716-d71aef89c4f3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:19.962610 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-66f1c9f4-0ca9-49fe-b716-d71aef89c4f3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:19.969067 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-66f1c9f4-0ca9-49fe-b716-d71aef89c4f3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:19.969524 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-66f1c9f4-0ca9-49fe-b716-d71aef89c4f3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:19.970289 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-66f1c9f4-0ca9-49fe-b716-d71aef89c4f3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:19.970724 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-66f1c9f4-0ca9-49fe-b716-d71aef89c4f3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:20.106582 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-66f1c9f4-0ca9-49fe-b716-d71aef89c4f3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:20.115191 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-66f1c9f4-0ca9-49fe-b716-d71aef89c4f3 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1757 microversion: 2.1 time: 0.156947 Apr 11 14:00:20.116116 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 295/591] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:19 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:20.349636 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ea456fc0-a422-4c50-b44e-6c633b5efbaf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:20.350624 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ea456fc0-a422-4c50-b44e-6c633b5efbaf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:20.357250 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea456fc0-a422-4c50-b44e-6c633b5efbaf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:20.357728 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea456fc0-a422-4c50-b44e-6c633b5efbaf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:20.358500 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea456fc0-a422-4c50-b44e-6c633b5efbaf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:20.358933 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea456fc0-a422-4c50-b44e-6c633b5efbaf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:20.388182 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ea456fc0-a422-4c50-b44e-6c633b5efbaf tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Apr 11 14:00:20.388761 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 297/592] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:00:20 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:00:20.547313 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-d5b44747-e1a2-4620-99b5-92f57abe93be req-ace03071-6f4a-42a8-931c-5a7f85b41d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12dff082-2604-43ab-bc96-80955e79ee1a", "name": "network-vif-deleted", "tag": "21c45b08-b8bb-4b42-b109-35cb831c8138"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:20.556031 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-d5b44747-e1a2-4620-99b5-92f57abe93be req-ace03071-6f4a-42a8-931c-5a7f85b41d5c service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:20.556486 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-d5b44747-e1a2-4620-99b5-92f57abe93be req-ace03071-6f4a-42a8-931c-5a7f85b41d5c service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:20.568747 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-d5b44747-e1a2-4620-99b5-92f57abe93be req-ace03071-6f4a-42a8-931c-5a7f85b41d5c service nova] Creating event network-vif-deleted:21c45b08-b8bb-4b42-b109-35cb831c8138 for instance 12dff082-2604-43ab-bc96-80955e79ee1a on hv-cinder-83078 Apr 11 14:00:20.574008 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-d5b44747-e1a2-4620-99b5-92f57abe93be req-ace03071-6f4a-42a8-931c-5a7f85b41d5c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030926 Apr 11 14:00:20.574679 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 296/593] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:00:20.662490 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e1a4aac9-9d32-4bca-aa90-37ae34390213 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:20.663104 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e1a4aac9-9d32-4bca-aa90-37ae34390213 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:20.669711 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e1a4aac9-9d32-4bca-aa90-37ae34390213 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:20.670080 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e1a4aac9-9d32-4bca-aa90-37ae34390213 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:20.670840 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e1a4aac9-9d32-4bca-aa90-37ae34390213 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:20.671446 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e1a4aac9-9d32-4bca-aa90-37ae34390213 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:20.799039 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e1a4aac9-9d32-4bca-aa90-37ae34390213 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:20.806746 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e1a4aac9-9d32-4bca-aa90-37ae34390213 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:20.808305 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e1a4aac9-9d32-4bca-aa90-37ae34390213 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:20.809448 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e1a4aac9-9d32-4bca-aa90-37ae34390213 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1407 microversion: 2.20 time: 0.150809 Apr 11 14:00:20.809988 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 298/594] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:20 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:20.948524 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b43d7d6e-00d2-4f27-8ec7-0583fcb5b8ae tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:20.949153 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b43d7d6e-00d2-4f27-8ec7-0583fcb5b8ae tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:20.955354 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b43d7d6e-00d2-4f27-8ec7-0583fcb5b8ae tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:20.955849 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b43d7d6e-00d2-4f27-8ec7-0583fcb5b8ae tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:20.956623 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b43d7d6e-00d2-4f27-8ec7-0583fcb5b8ae tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:20.957068 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b43d7d6e-00d2-4f27-8ec7-0583fcb5b8ae tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:20.987470 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b43d7d6e-00d2-4f27-8ec7-0583fcb5b8ae tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:20.987964 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b43d7d6e-00d2-4f27-8ec7-0583fcb5b8ae tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:20.988419 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-b43d7d6e-00d2-4f27-8ec7-0583fcb5b8ae tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lazy-loading 'fault' on Instance uuid 12dff082-2604-43ab-bc96-80955e79ee1a {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:00:21.032161 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b43d7d6e-00d2-4f27-8ec7-0583fcb5b8ae tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57da915d2c14f1484f6a30c86d4eadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62982ff988ec462a8189ea9ba7c8496b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:21.039401 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b43d7d6e-00d2-4f27-8ec7-0583fcb5b8ae tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 200 len: 1308 microversion: 2.1 time: 0.095199 Apr 11 14:00:21.040003 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 297/595] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:20 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:21.400951 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-34546bef-9ce0-4172-98d3-52655ff6c317 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:21.401928 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-34546bef-9ce0-4172-98d3-52655ff6c317 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:21.418647 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34546bef-9ce0-4172-98d3-52655ff6c317 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:21.419258 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34546bef-9ce0-4172-98d3-52655ff6c317 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:21.420122 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34546bef-9ce0-4172-98d3-52655ff6c317 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:21.420545 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34546bef-9ce0-4172-98d3-52655ff6c317 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:21.450503 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-34546bef-9ce0-4172-98d3-52655ff6c317 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054801 Apr 11 14:00:21.451074 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 299/596] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:00:21 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 14:00:21.522633 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-047e1801-c0ef-40a6-976c-1bf72487a540 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:21.523136 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-047e1801-c0ef-40a6-976c-1bf72487a540 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:21.529736 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-047e1801-c0ef-40a6-976c-1bf72487a540 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:21.530188 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-047e1801-c0ef-40a6-976c-1bf72487a540 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:21.530956 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-047e1801-c0ef-40a6-976c-1bf72487a540 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:21.531397 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-047e1801-c0ef-40a6-976c-1bf72487a540 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:21.555852 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-047e1801-c0ef-40a6-976c-1bf72487a540 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:00:21.632662 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-047e1801-c0ef-40a6-976c-1bf72487a540 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 204 len: 0 microversion: 2.1 time: 0.113708 Apr 11 14:00:21.633632 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 298/597] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:00:21 2022] DELETE /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:00:21.642109 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e73a4700-00e2-469b-b7ec-a460d701a715 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:21.642819 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e73a4700-00e2-469b-b7ec-a460d701a715 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:21.649316 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e73a4700-00e2-469b-b7ec-a460d701a715 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:21.649772 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e73a4700-00e2-469b-b7ec-a460d701a715 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:21.650549 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e73a4700-00e2-469b-b7ec-a460d701a715 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:21.650986 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e73a4700-00e2-469b-b7ec-a460d701a715 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:21.787149 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e73a4700-00e2-469b-b7ec-a460d701a715 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:21.795677 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e73a4700-00e2-469b-b7ec-a460d701a715 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1687 microversion: 2.1 time: 0.157588 Apr 11 14:00:21.796250 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 300/598] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:21 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:21.827391 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e3c2c30c-63cb-4c7f-a3db-964d98e55b49 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:21.828239 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e3c2c30c-63cb-4c7f-a3db-964d98e55b49 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:21.834219 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e3c2c30c-63cb-4c7f-a3db-964d98e55b49 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:21.834678 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e3c2c30c-63cb-4c7f-a3db-964d98e55b49 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:21.835481 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e3c2c30c-63cb-4c7f-a3db-964d98e55b49 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:21.835925 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e3c2c30c-63cb-4c7f-a3db-964d98e55b49 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:21.962389 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e3c2c30c-63cb-4c7f-a3db-964d98e55b49 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:21.970909 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e3c2c30c-63cb-4c7f-a3db-964d98e55b49 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:21.972519 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e3c2c30c-63cb-4c7f-a3db-964d98e55b49 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:21.973679 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e3c2c30c-63cb-4c7f-a3db-964d98e55b49 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1407 microversion: 2.20 time: 0.151104 Apr 11 14:00:21.974252 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 299/599] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:21 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:22.057456 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5c8c6d38-a8ed-4d62-9d5d-89eb84648906 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:22.058081 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5c8c6d38-a8ed-4d62-9d5d-89eb84648906 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] [instance: 12dff082-2604-43ab-bc96-80955e79ee1a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:22.064482 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c8c6d38-a8ed-4d62-9d5d-89eb84648906 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:22.064932 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c8c6d38-a8ed-4d62-9d5d-89eb84648906 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:22.065699 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c8c6d38-a8ed-4d62-9d5d-89eb84648906 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:22.066134 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c8c6d38-a8ed-4d62-9d5d-89eb84648906 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:22.079067 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-5c8c6d38-a8ed-4d62-9d5d-89eb84648906 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] HTTP exception thrown: Instance 12dff082-2604-43ab-bc96-80955e79ee1a could not be found. Apr 11 14:00:22.079667 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5c8c6d38-a8ed-4d62-9d5d-89eb84648906 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] Returning 404 to user: Instance 12dff082-2604-43ab-bc96-80955e79ee1a could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:00:22.080486 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5c8c6d38-a8ed-4d62-9d5d-89eb84648906 tempest-VolumesSnapshotTestJSON-930763727 tempest-VolumesSnapshotTestJSON-930763727-project] 10.222.0.67 "GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a" status: 404 len: 111 microversion: 2.1 time: 0.026845 Apr 11 14:00:22.081031 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 301/600] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:22 2022] GET /compute/v2.1/servers/12dff082-2604-43ab-bc96-80955e79ee1a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:00:22.813473 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-db69f0eb-fa85-4f2f-97a6-a30b4ced12f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:22.814099 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-db69f0eb-fa85-4f2f-97a6-a30b4ced12f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:22.820395 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db69f0eb-fa85-4f2f-97a6-a30b4ced12f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:22.820848 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db69f0eb-fa85-4f2f-97a6-a30b4ced12f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:22.821621 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db69f0eb-fa85-4f2f-97a6-a30b4ced12f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:22.822063 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db69f0eb-fa85-4f2f-97a6-a30b4ced12f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:22.948181 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-db69f0eb-fa85-4f2f-97a6-a30b4ced12f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:22.955427 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-db69f0eb-fa85-4f2f-97a6-a30b4ced12f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1687 microversion: 2.1 time: 0.146668 Apr 11 14:00:22.956044 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 300/601] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:22 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1687 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:22.991415 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-195c83b4-461c-4c0a-bba5-b8ce88ebcc64 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:22.992050 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-195c83b4-461c-4c0a-bba5-b8ce88ebcc64 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:22.998383 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-195c83b4-461c-4c0a-bba5-b8ce88ebcc64 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:22.998821 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-195c83b4-461c-4c0a-bba5-b8ce88ebcc64 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:22.999594 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-195c83b4-461c-4c0a-bba5-b8ce88ebcc64 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:23.000057 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-195c83b4-461c-4c0a-bba5-b8ce88ebcc64 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:23.122878 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-195c83b4-461c-4c0a-bba5-b8ce88ebcc64 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:23.130539 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-195c83b4-461c-4c0a-bba5-b8ce88ebcc64 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:23.132058 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-195c83b4-461c-4c0a-bba5-b8ce88ebcc64 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:23.133155 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-195c83b4-461c-4c0a-bba5-b8ce88ebcc64 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1407 microversion: 2.20 time: 0.145600 Apr 11 14:00:23.133708 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 302/602] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:22 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:23.972261 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-87986287-f4f4-411b-8514-eb3e11233f1f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:23.972881 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-87986287-f4f4-411b-8514-eb3e11233f1f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:23.979470 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-87986287-f4f4-411b-8514-eb3e11233f1f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:23.979962 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-87986287-f4f4-411b-8514-eb3e11233f1f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:23.980950 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-87986287-f4f4-411b-8514-eb3e11233f1f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:23.981401 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-87986287-f4f4-411b-8514-eb3e11233f1f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:24.107233 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-87986287-f4f4-411b-8514-eb3e11233f1f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:24.114436 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-87986287-f4f4-411b-8514-eb3e11233f1f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1687 microversion: 2.1 time: 0.146039 Apr 11 14:00:24.115000 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 301/603] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:23 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1687 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:24.150168 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c9be8f36-62bc-48ce-ac26-33d66eab65e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:24.150783 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c9be8f36-62bc-48ce-ac26-33d66eab65e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:24.157578 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9be8f36-62bc-48ce-ac26-33d66eab65e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:24.158030 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9be8f36-62bc-48ce-ac26-33d66eab65e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:24.158800 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9be8f36-62bc-48ce-ac26-33d66eab65e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:24.159272 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9be8f36-62bc-48ce-ac26-33d66eab65e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:24.284220 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c9be8f36-62bc-48ce-ac26-33d66eab65e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:24.291986 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c9be8f36-62bc-48ce-ac26-33d66eab65e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:24.294052 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c9be8f36-62bc-48ce-ac26-33d66eab65e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:24.295176 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c9be8f36-62bc-48ce-ac26-33d66eab65e6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1407 microversion: 2.20 time: 0.148934 Apr 11 14:00:24.295760 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 303/604] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:24 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:25.131695 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-21985309-c418-4355-add8-b9c0d978dc7b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:25.132346 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-21985309-c418-4355-add8-b9c0d978dc7b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:25.139331 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-21985309-c418-4355-add8-b9c0d978dc7b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:25.139824 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-21985309-c418-4355-add8-b9c0d978dc7b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:25.140598 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-21985309-c418-4355-add8-b9c0d978dc7b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:25.141071 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-21985309-c418-4355-add8-b9c0d978dc7b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:25.267353 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-21985309-c418-4355-add8-b9c0d978dc7b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:25.274788 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-21985309-c418-4355-add8-b9c0d978dc7b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1687 microversion: 2.1 time: 0.146942 Apr 11 14:00:25.275359 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 302/605] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:25 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1687 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:25.313072 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-55975de1-bef5-44ec-9187-f40c4da25328 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:25.313696 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-55975de1-bef5-44ec-9187-f40c4da25328 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:25.319931 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-55975de1-bef5-44ec-9187-f40c4da25328 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:25.320410 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-55975de1-bef5-44ec-9187-f40c4da25328 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:25.321173 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-55975de1-bef5-44ec-9187-f40c4da25328 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:25.321607 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-55975de1-bef5-44ec-9187-f40c4da25328 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:25.446235 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-55975de1-bef5-44ec-9187-f40c4da25328 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:25.454486 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-55975de1-bef5-44ec-9187-f40c4da25328 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:25.456023 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-55975de1-bef5-44ec-9187-f40c4da25328 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:25.457130 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-55975de1-bef5-44ec-9187-f40c4da25328 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1407 microversion: 2.20 time: 0.148373 Apr 11 14:00:25.457693 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 304/606] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:25 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:26.293434 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d7648e99-bfdc-49b0-adab-d6e9d72d8387 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:26.294059 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d7648e99-bfdc-49b0-adab-d6e9d72d8387 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:26.300192 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d7648e99-bfdc-49b0-adab-d6e9d72d8387 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:26.300652 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d7648e99-bfdc-49b0-adab-d6e9d72d8387 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:26.301436 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d7648e99-bfdc-49b0-adab-d6e9d72d8387 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:26.301880 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d7648e99-bfdc-49b0-adab-d6e9d72d8387 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:26.436415 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d7648e99-bfdc-49b0-adab-d6e9d72d8387 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:26.444459 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d7648e99-bfdc-49b0-adab-d6e9d72d8387 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1687 microversion: 2.1 time: 0.156044 Apr 11 14:00:26.445451 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 303/607] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:26 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:26.474258 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ea3f18ab-4a80-4c2f-b845-603e65b7a4cc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:26.474880 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ea3f18ab-4a80-4c2f-b845-603e65b7a4cc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:26.481356 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea3f18ab-4a80-4c2f-b845-603e65b7a4cc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:26.481807 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea3f18ab-4a80-4c2f-b845-603e65b7a4cc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:26.482580 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea3f18ab-4a80-4c2f-b845-603e65b7a4cc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:26.483015 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea3f18ab-4a80-4c2f-b845-603e65b7a4cc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:26.611251 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ea3f18ab-4a80-4c2f-b845-603e65b7a4cc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:26.619442 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ea3f18ab-4a80-4c2f-b845-603e65b7a4cc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:26.621022 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ea3f18ab-4a80-4c2f-b845-603e65b7a4cc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:26.622170 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ea3f18ab-4a80-4c2f-b845-603e65b7a4cc tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1407 microversion: 2.20 time: 0.151831 Apr 11 14:00:26.622728 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 305/608] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:26 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:27.462313 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0e70c1c5-eae8-4853-92f1-5682cb675055 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:27.462939 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0e70c1c5-eae8-4853-92f1-5682cb675055 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:27.470318 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e70c1c5-eae8-4853-92f1-5682cb675055 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:27.470781 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e70c1c5-eae8-4853-92f1-5682cb675055 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:27.471556 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e70c1c5-eae8-4853-92f1-5682cb675055 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:27.472025 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e70c1c5-eae8-4853-92f1-5682cb675055 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:27.599375 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0e70c1c5-eae8-4853-92f1-5682cb675055 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:27.607033 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0e70c1c5-eae8-4853-92f1-5682cb675055 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 200 len: 1687 microversion: 2.1 time: 0.148496 Apr 11 14:00:27.607644 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 304/609] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:27 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:27.640064 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-88db17c1-c2e3-479e-ba99-093668b3df8f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:27.641228 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-88db17c1-c2e3-479e-ba99-093668b3df8f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:27.647793 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88db17c1-c2e3-479e-ba99-093668b3df8f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:27.648301 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88db17c1-c2e3-479e-ba99-093668b3df8f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:27.649027 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88db17c1-c2e3-479e-ba99-093668b3df8f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:27.649464 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88db17c1-c2e3-479e-ba99-093668b3df8f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:27.854167 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-88db17c1-c2e3-479e-ba99-093668b3df8f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:27.863249 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-88db17c1-c2e3-479e-ba99-093668b3df8f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:27.864822 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-88db17c1-c2e3-479e-ba99-093668b3df8f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:27.865999 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-88db17c1-c2e3-479e-ba99-093668b3df8f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1599 microversion: 2.20 time: 0.229995 Apr 11 14:00:27.866565 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 306/610] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:00:27 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:00:27.883795 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9818d3de-7632-4949-8107-93f8ac70480d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:27.884306 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9818d3de-7632-4949-8107-93f8ac70480d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:27.890641 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9818d3de-7632-4949-8107-93f8ac70480d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:27.891098 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9818d3de-7632-4949-8107-93f8ac70480d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:27.891902 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9818d3de-7632-4949-8107-93f8ac70480d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:27.892345 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9818d3de-7632-4949-8107-93f8ac70480d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:27.975489 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9818d3de-7632-4949-8107-93f8ac70480d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095631 Apr 11 14:00:27.976588 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 305/611] 10.222.0.67 () {60 vars in 1315 bytes} [Mon Apr 11 14:00:27 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 14:00:28.065437 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-93830068-9984-4bb2-a86a-ae781a7b6616 req-c773ebbd-28f1-4303-a2f6-95ed1f8dbe0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b122bc-5193-4642-9f21-0e30c573c88e", "name": "network-vif-deleted", "tag": "dd31c02f-d45d-4905-89c8-0c0d76d81cb0"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:28.076123 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-93830068-9984-4bb2-a86a-ae781a7b6616 req-c773ebbd-28f1-4303-a2f6-95ed1f8dbe0e service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:28.076798 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-93830068-9984-4bb2-a86a-ae781a7b6616 req-c773ebbd-28f1-4303-a2f6-95ed1f8dbe0e service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:28.089639 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-93830068-9984-4bb2-a86a-ae781a7b6616 req-c773ebbd-28f1-4303-a2f6-95ed1f8dbe0e service nova] Creating event network-vif-deleted:dd31c02f-d45d-4905-89c8-0c0d76d81cb0 for instance a1b122bc-5193-4642-9f21-0e30c573c88e on hv-cinder-83078 Apr 11 14:00:28.104265 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-93830068-9984-4bb2-a86a-ae781a7b6616 req-c773ebbd-28f1-4303-a2f6-95ed1f8dbe0e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042279 Apr 11 14:00:28.108589 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 307/612] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:00:28.625445 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-869bbf91-65fb-447a-a56d-4d79dfcd004f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:28.626055 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-869bbf91-65fb-447a-a56d-4d79dfcd004f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a1b122bc-5193-4642-9f21-0e30c573c88e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:28.632109 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-869bbf91-65fb-447a-a56d-4d79dfcd004f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:28.632577 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-869bbf91-65fb-447a-a56d-4d79dfcd004f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:28.633359 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-869bbf91-65fb-447a-a56d-4d79dfcd004f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:28.633803 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-869bbf91-65fb-447a-a56d-4d79dfcd004f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:28.647463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-869bbf91-65fb-447a-a56d-4d79dfcd004f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] HTTP exception thrown: Instance a1b122bc-5193-4642-9f21-0e30c573c88e could not be found. Apr 11 14:00:28.648097 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-869bbf91-65fb-447a-a56d-4d79dfcd004f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Returning 404 to user: Instance a1b122bc-5193-4642-9f21-0e30c573c88e could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:00:28.648944 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-869bbf91-65fb-447a-a56d-4d79dfcd004f tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e" status: 404 len: 111 microversion: 2.1 time: 0.028599 Apr 11 14:00:28.649500 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 306/613] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:28 2022] GET /compute/v2.1/servers/a1b122bc-5193-4642-9f21-0e30c573c88e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:00:28.659706 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e40d5455-75d4-4eab-ad7b-a506522e8239 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '.version_select at 0x7f7306ad6820>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:28.685312 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e40d5455-75d4-4eab-ad7b-a506522e8239 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-411134286" status: 202 len: 0 microversion: 2.1 time: 0.030703 Apr 11 14:00:28.685824 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 308/614] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Apr 11 14:00:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-411134286 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:00:30.132289 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-080bd073-7c24-4e53-825d-8c35c0a4f85b req-05547b68-1dc4-42ab-b963-e2cf12ba907c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf497683-01c3-4106-adb0-36d23d564607", "tag": "9c6a342b-a134-4ab5-996e-3eab3c406817"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:30.140894 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-080bd073-7c24-4e53-825d-8c35c0a4f85b req-05547b68-1dc4-42ab-b963-e2cf12ba907c service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:30.141348 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-080bd073-7c24-4e53-825d-8c35c0a4f85b req-05547b68-1dc4-42ab-b963-e2cf12ba907c service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:30.152896 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-080bd073-7c24-4e53-825d-8c35c0a4f85b req-05547b68-1dc4-42ab-b963-e2cf12ba907c service nova] Creating event network-changed:9c6a342b-a134-4ab5-996e-3eab3c406817 for instance cf497683-01c3-4106-adb0-36d23d564607 on hv-cinder-83078 Apr 11 14:00:30.158729 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-080bd073-7c24-4e53-825d-8c35c0a4f85b req-05547b68-1dc4-42ab-b963-e2cf12ba907c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030020 Apr 11 14:00:30.159340 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 307/615] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:00:31.739620 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8636cd73-6011-46cd-b551-1360d51f3b73 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:31.740247 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8636cd73-6011-46cd-b551-1360d51f3b73 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:31.747361 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8636cd73-6011-46cd-b551-1360d51f3b73 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:31.747834 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8636cd73-6011-46cd-b551-1360d51f3b73 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:31.748596 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8636cd73-6011-46cd-b551-1360d51f3b73 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:31.749055 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8636cd73-6011-46cd-b551-1360d51f3b73 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:31.772106 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8636cd73-6011-46cd-b551-1360d51f3b73 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:00:31.851902 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8636cd73-6011-46cd-b551-1360d51f3b73 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 204 len: 0 microversion: 2.1 time: 0.115807 Apr 11 14:00:31.852659 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 309/616] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:00:31 2022] DELETE /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:00:31.861007 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3c262e67-f715-4167-a03c-6fc9f90f5a7e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:31.861799 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3c262e67-f715-4167-a03c-6fc9f90f5a7e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:31.868902 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c262e67-f715-4167-a03c-6fc9f90f5a7e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:31.869614 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c262e67-f715-4167-a03c-6fc9f90f5a7e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:31.870656 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c262e67-f715-4167-a03c-6fc9f90f5a7e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:31.871178 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c262e67-f715-4167-a03c-6fc9f90f5a7e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:32.051874 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3c262e67-f715-4167-a03c-6fc9f90f5a7e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:32.059707 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3c262e67-f715-4167-a03c-6fc9f90f5a7e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1507 microversion: 2.1 time: 0.202813 Apr 11 14:00:32.060276 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 308/617] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:31 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:33.077930 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-49ef1add-6082-43af-81ba-87b3faa5042e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:33.078542 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-49ef1add-6082-43af-81ba-87b3faa5042e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:33.084996 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-49ef1add-6082-43af-81ba-87b3faa5042e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:33.085450 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-49ef1add-6082-43af-81ba-87b3faa5042e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:33.086221 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-49ef1add-6082-43af-81ba-87b3faa5042e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:33.086653 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-49ef1add-6082-43af-81ba-87b3faa5042e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:33.262868 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-49ef1add-6082-43af-81ba-87b3faa5042e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:33.270299 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-49ef1add-6082-43af-81ba-87b3faa5042e tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1507 microversion: 2.1 time: 0.197181 Apr 11 14:00:33.270875 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 310/618] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:33 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1507 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:34.287925 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c0ba68b1-84ca-4975-beae-3d75be7c6111 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:34.288690 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c0ba68b1-84ca-4975-beae-3d75be7c6111 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:34.295715 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c0ba68b1-84ca-4975-beae-3d75be7c6111 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:34.296174 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c0ba68b1-84ca-4975-beae-3d75be7c6111 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:34.296937 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c0ba68b1-84ca-4975-beae-3d75be7c6111 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:34.297375 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c0ba68b1-84ca-4975-beae-3d75be7c6111 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:34.423562 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c0ba68b1-84ca-4975-beae-3d75be7c6111 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:34.431027 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c0ba68b1-84ca-4975-beae-3d75be7c6111 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1507 microversion: 2.1 time: 0.146922 Apr 11 14:00:34.431600 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 309/619] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:34 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:35.447749 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-54f42810-66cd-4b28-8bd3-804b30beb5f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:35.448299 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-54f42810-66cd-4b28-8bd3-804b30beb5f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:35.454852 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-54f42810-66cd-4b28-8bd3-804b30beb5f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:35.455308 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-54f42810-66cd-4b28-8bd3-804b30beb5f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:35.456113 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-54f42810-66cd-4b28-8bd3-804b30beb5f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:35.456555 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-54f42810-66cd-4b28-8bd3-804b30beb5f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:35.589808 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-54f42810-66cd-4b28-8bd3-804b30beb5f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:35.597089 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-54f42810-66cd-4b28-8bd3-804b30beb5f3 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1507 microversion: 2.1 time: 0.153236 Apr 11 14:00:35.597744 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 311/620] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:35 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:36.614476 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5f162a87-b530-4ebd-827b-486d882f3bb5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:36.615140 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5f162a87-b530-4ebd-827b-486d882f3bb5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:36.621952 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5f162a87-b530-4ebd-827b-486d882f3bb5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:36.622406 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5f162a87-b530-4ebd-827b-486d882f3bb5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:36.623187 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5f162a87-b530-4ebd-827b-486d882f3bb5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:36.623622 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5f162a87-b530-4ebd-827b-486d882f3bb5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:36.754961 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5f162a87-b530-4ebd-827b-486d882f3bb5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:36.762770 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5f162a87-b530-4ebd-827b-486d882f3bb5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 200 len: 1507 microversion: 2.1 time: 0.152323 Apr 11 14:00:36.763669 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 310/621] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:36 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:37.014715 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-07e0caeb-08a1-4401-9e3a-9fb41fc16fbc req-ffdf9fec-6c79-4c90-a27f-914575fa8963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e921e1-7746-446b-bad6-d7188f8bdac2", "name": "network-vif-deleted", "tag": "41becb52-f1e7-4c33-ad5e-faa52141b7c9"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:37.024495 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-07e0caeb-08a1-4401-9e3a-9fb41fc16fbc req-ffdf9fec-6c79-4c90-a27f-914575fa8963 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:37.024942 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-07e0caeb-08a1-4401-9e3a-9fb41fc16fbc req-ffdf9fec-6c79-4c90-a27f-914575fa8963 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:37.042004 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-07e0caeb-08a1-4401-9e3a-9fb41fc16fbc req-ffdf9fec-6c79-4c90-a27f-914575fa8963 service nova] Creating event network-vif-deleted:41becb52-f1e7-4c33-ad5e-faa52141b7c9 for instance a6e921e1-7746-446b-bad6-d7188f8bdac2 on hv-cinder-83078 Apr 11 14:00:37.047777 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-07e0caeb-08a1-4401-9e3a-9fb41fc16fbc req-ffdf9fec-6c79-4c90-a27f-914575fa8963 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037292 Apr 11 14:00:37.048557 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 312/622] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:00:37.845320 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-586ae541-dd58-433d-938e-8b13b1f805cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:37.846197 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-586ae541-dd58-433d-938e-8b13b1f805cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: a6e921e1-7746-446b-bad6-d7188f8bdac2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:37.852061 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-586ae541-dd58-433d-938e-8b13b1f805cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:37.852550 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-586ae541-dd58-433d-938e-8b13b1f805cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:37.853323 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-586ae541-dd58-433d-938e-8b13b1f805cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:37.853762 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-586ae541-dd58-433d-938e-8b13b1f805cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:37.866818 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-586ae541-dd58-433d-938e-8b13b1f805cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] HTTP exception thrown: Instance a6e921e1-7746-446b-bad6-d7188f8bdac2 could not be found. Apr 11 14:00:37.867459 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-586ae541-dd58-433d-938e-8b13b1f805cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Returning 404 to user: Instance a6e921e1-7746-446b-bad6-d7188f8bdac2 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:00:37.868369 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-586ae541-dd58-433d-938e-8b13b1f805cd tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2" status: 404 len: 111 microversion: 2.1 time: 0.091190 Apr 11 14:00:37.868920 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 311/623] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:37 2022] GET /compute/v2.1/servers/a6e921e1-7746-446b-bad6-d7188f8bdac2 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:00:37.877404 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-98657dc1-d959-430a-82cc-ffa27837a244 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:37.877987 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-98657dc1-d959-430a-82cc-ffa27837a244 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:37.884018 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-98657dc1-d959-430a-82cc-ffa27837a244 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:37.884472 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-98657dc1-d959-430a-82cc-ffa27837a244 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:37.885234 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-98657dc1-d959-430a-82cc-ffa27837a244 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:37.886212 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-98657dc1-d959-430a-82cc-ffa27837a244 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:37.909993 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-98657dc1-d959-430a-82cc-ffa27837a244 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:00:37.981712 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-98657dc1-d959-430a-82cc-ffa27837a244 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "DELETE /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 204 len: 0 microversion: 2.1 time: 0.108150 Apr 11 14:00:37.982288 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 313/624] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:00:37 2022] DELETE /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:00:37.990216 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5b06f1d1-917a-4639-a3ae-a8e71ab95db5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:37.990855 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5b06f1d1-917a-4639-a3ae-a8e71ab95db5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:37.997263 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5b06f1d1-917a-4639-a3ae-a8e71ab95db5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:37.997720 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5b06f1d1-917a-4639-a3ae-a8e71ab95db5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:37.998489 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5b06f1d1-917a-4639-a3ae-a8e71ab95db5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:37.998927 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5b06f1d1-917a-4639-a3ae-a8e71ab95db5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:38.279700 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5b06f1d1-917a-4639-a3ae-a8e71ab95db5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:38.287178 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5b06f1d1-917a-4639-a3ae-a8e71ab95db5 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.300792 Apr 11 14:00:38.287763 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 312/625] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:37 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:39.304660 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-92cad221-063c-498a-9688-6b945bb33d6d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:39.305360 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-92cad221-063c-498a-9688-6b945bb33d6d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:39.311542 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92cad221-063c-498a-9688-6b945bb33d6d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:39.312017 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92cad221-063c-498a-9688-6b945bb33d6d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:39.312779 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92cad221-063c-498a-9688-6b945bb33d6d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:39.313216 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92cad221-063c-498a-9688-6b945bb33d6d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:39.439259 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-92cad221-063c-498a-9688-6b945bb33d6d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:39.446549 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-92cad221-063c-498a-9688-6b945bb33d6d tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.146147 Apr 11 14:00:39.447107 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 314/626] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:39 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:40.397707 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 14:00:40.398367 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: Mon Apr 11 14:00:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 14:00:40.464295 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-27aa9284-e390-4d88-b53c-0295ad115ba6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:40.464943 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-27aa9284-e390-4d88-b53c-0295ad115ba6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:40.471183 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-27aa9284-e390-4d88-b53c-0295ad115ba6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:40.471661 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-27aa9284-e390-4d88-b53c-0295ad115ba6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:40.472434 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-27aa9284-e390-4d88-b53c-0295ad115ba6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:40.472876 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-27aa9284-e390-4d88-b53c-0295ad115ba6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:40.599606 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-27aa9284-e390-4d88-b53c-0295ad115ba6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:40.607423 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-27aa9284-e390-4d88-b53c-0295ad115ba6 tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.147503 Apr 11 14:00:40.608066 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 313/627] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:40 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:41.624541 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6242355c-8b66-435a-9042-3fb9becb22df tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:41.625132 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6242355c-8b66-435a-9042-3fb9becb22df tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:41.631896 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6242355c-8b66-435a-9042-3fb9becb22df tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:41.632343 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6242355c-8b66-435a-9042-3fb9becb22df tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:41.633097 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6242355c-8b66-435a-9042-3fb9becb22df tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:41.633528 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6242355c-8b66-435a-9042-3fb9becb22df tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:41.853550 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6242355c-8b66-435a-9042-3fb9becb22df tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe3f01cd2f742f4903ed97da6b6923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9487af89de4df6b7592a993fc4827e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:41.861651 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6242355c-8b66-435a-9042-3fb9becb22df tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 200 len: 1521 microversion: 2.1 time: 0.241070 Apr 11 14:00:41.862228 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 315/628] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:41 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:42.203047 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-255ba8e5-a89f-4cc3-92f8-ad8181ac08e7 req-63dab420-1bd7-4200-a8cb-6db3981fcbf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea0ff31-35c2-4763-bf7a-6d0aada0558c", "name": "network-vif-deleted", "tag": "b53ccbb2-cadf-467b-980a-34cb619111ad"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:42.223422 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-255ba8e5-a89f-4cc3-92f8-ad8181ac08e7 req-63dab420-1bd7-4200-a8cb-6db3981fcbf5 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:42.223922 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-255ba8e5-a89f-4cc3-92f8-ad8181ac08e7 req-63dab420-1bd7-4200-a8cb-6db3981fcbf5 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:42.235814 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-255ba8e5-a89f-4cc3-92f8-ad8181ac08e7 req-63dab420-1bd7-4200-a8cb-6db3981fcbf5 service nova] Creating event network-vif-deleted:b53ccbb2-cadf-467b-980a-34cb619111ad for instance eea0ff31-35c2-4763-bf7a-6d0aada0558c on hv-cinder-83078 Apr 11 14:00:42.245746 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-255ba8e5-a89f-4cc3-92f8-ad8181ac08e7 req-63dab420-1bd7-4200-a8cb-6db3981fcbf5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048843 Apr 11 14:00:42.246327 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 314/629] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:00:42.878887 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-12dc7dfa-23fc-4848-8080-a59a177ffd5b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:42.879504 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-12dc7dfa-23fc-4848-8080-a59a177ffd5b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] [instance: eea0ff31-35c2-4763-bf7a-6d0aada0558c] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:42.885353 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-12dc7dfa-23fc-4848-8080-a59a177ffd5b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:42.885790 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-12dc7dfa-23fc-4848-8080-a59a177ffd5b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:42.886546 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-12dc7dfa-23fc-4848-8080-a59a177ffd5b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:42.886979 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-12dc7dfa-23fc-4848-8080-a59a177ffd5b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:42.899533 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-12dc7dfa-23fc-4848-8080-a59a177ffd5b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] HTTP exception thrown: Instance eea0ff31-35c2-4763-bf7a-6d0aada0558c could not be found. Apr 11 14:00:42.900128 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-12dc7dfa-23fc-4848-8080-a59a177ffd5b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] Returning 404 to user: Instance eea0ff31-35c2-4763-bf7a-6d0aada0558c could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:00:42.900926 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-12dc7dfa-23fc-4848-8080-a59a177ffd5b tempest-ServerRescueNegativeTestJSON-912529347 tempest-ServerRescueNegativeTestJSON-912529347-project] 10.222.0.67 "GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c" status: 404 len: 111 microversion: 2.1 time: 0.026262 Apr 11 14:00:42.901438 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 316/630] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:42 2022] GET /compute/v2.1/servers/eea0ff31-35c2-4763-bf7a-6d0aada0558c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:00:51.793218 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-51cb0192-548f-4f38-81cd-6b0c8647c9c0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Action: 'create', calling method: .version_select at 0x7f730883d820>, body: {"keypair": {"name": "tempest-keypair-1079818213"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:51.810614 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-51cb0192-548f-4f38-81cd-6b0c8647c9c0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:00:51.814694 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-51cb0192-548f-4f38-81cd-6b0c8647c9c0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for user 2cbcdc40fea745f48e1dfc62a732b7ee and project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:00:52.021069 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-51cb0192-548f-4f38-81cd-6b0c8647c9c0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:00:52.024800 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-51cb0192-548f-4f38-81cd-6b0c8647c9c0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for user 2cbcdc40fea745f48e1dfc62a732b7ee and project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:00:52.037991 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-51cb0192-548f-4f38-81cd-6b0c8647c9c0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.369634 Apr 11 14:00:52.038511 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 315/631] 10.222.0.67 () {60 vars in 1157 bytes} [Mon Apr 11 14:00:51 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:53.272152 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-411094239", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "730a24f2-5d00-49fb-895d-b884d9163131"}], "security_groups": [{"name": "tempest-securitygroup--1803549458"}], "key_name": "tempest-keypair-1079818213", "user_data": "}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:53.398095 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] validate_networks() for [('730a24f2-5d00-49fb-895d-b884d9163131', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 14:00:53.843214 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 14:00:53.843663 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 14:00:53.844207 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 14:00:53.844617 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 14:00:53.845029 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 14:00:53.853719 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:53.854169 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:53.854978 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:53.855416 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:53.872123 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:00:53.876239 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for user 2cbcdc40fea745f48e1dfc62a732b7ee and project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:00:53.888172 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 14:00:53.890430 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 14:00:53.946212 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8527b48d-ef68-4ae6-b2a2-3f6ee82dce94 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.678490 Apr 11 14:00:53.947762 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 317/632] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 14:00:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 14:00:53.965311 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f0466845-600a-41c8-886d-d4b00a5527e9 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:53.966048 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f0466845-600a-41c8-886d-d4b00a5527e9 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:54.023465 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f0466845-600a-41c8-886d-d4b00a5527e9 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:54.032296 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f0466845-600a-41c8-886d-d4b00a5527e9 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1241 microversion: 2.1 time: 0.071408 Apr 11 14:00:54.033598 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 316/633] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:53 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:55.049928 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d875bc1a-2e5b-4048-8889-c4a1b3d7b496 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:55.050650 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d875bc1a-2e5b-4048-8889-c4a1b3d7b496 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:55.057990 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d875bc1a-2e5b-4048-8889-c4a1b3d7b496 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:55.058437 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d875bc1a-2e5b-4048-8889-c4a1b3d7b496 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:55.059213 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d875bc1a-2e5b-4048-8889-c4a1b3d7b496 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:55.059657 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d875bc1a-2e5b-4048-8889-c4a1b3d7b496 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:55.143893 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1776241c-1d4e-4740-9f36-78cfdc3bb982 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:55.144957 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1776241c-1d4e-4740-9f36-78cfdc3bb982 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:55.149571 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d875bc1a-2e5b-4048-8889-c4a1b3d7b496 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:55.153191 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1776241c-1d4e-4740-9f36-78cfdc3bb982 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:55.154064 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1776241c-1d4e-4740-9f36-78cfdc3bb982 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:55.155976 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1776241c-1d4e-4740-9f36-78cfdc3bb982 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:55.157222 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1776241c-1d4e-4740-9f36-78cfdc3bb982 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:55.159343 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d875bc1a-2e5b-4048-8889-c4a1b3d7b496 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1293 microversion: 2.1 time: 0.113682 Apr 11 14:00:55.160187 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 318/634] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:55 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1293 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:55.202724 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1776241c-1d4e-4740-9f36-78cfdc3bb982 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064501 Apr 11 14:00:55.203726 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 317/635] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:00:55 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 14:00:55.279281 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b89219e9-bf48-4d02-b71b-bf32624fbb90 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:55.280217 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b89219e9-bf48-4d02-b71b-bf32624fbb90 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:55.286985 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b89219e9-bf48-4d02-b71b-bf32624fbb90 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:55.295429 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b89219e9-bf48-4d02-b71b-bf32624fbb90 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:55.296763 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b89219e9-bf48-4d02-b71b-bf32624fbb90 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:55.297443 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b89219e9-bf48-4d02-b71b-bf32624fbb90 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:55.324650 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b89219e9-bf48-4d02-b71b-bf32624fbb90 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:00:55.410237 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b89219e9-bf48-4d02-b71b-bf32624fbb90 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "DELETE /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 204 len: 0 microversion: 2.1 time: 0.136642 Apr 11 14:00:55.414299 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 319/636] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:00:55 2022] DELETE /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:00:55.419893 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-735f2bfc-dd91-4622-8363-5fd069d6fad5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:55.420669 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-735f2bfc-dd91-4622-8363-5fd069d6fad5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:55.437148 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-735f2bfc-dd91-4622-8363-5fd069d6fad5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:55.437884 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-735f2bfc-dd91-4622-8363-5fd069d6fad5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:55.438889 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-735f2bfc-dd91-4622-8363-5fd069d6fad5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:55.439528 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-735f2bfc-dd91-4622-8363-5fd069d6fad5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:55.584439 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-735f2bfc-dd91-4622-8363-5fd069d6fad5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:55.593171 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-735f2bfc-dd91-4622-8363-5fd069d6fad5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1673 microversion: 2.1 time: 0.177602 Apr 11 14:00:55.594006 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 318/637] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:55 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:00:56.177493 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1cca9d99-974f-4f5e-b47e-47ea525e564e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:56.178160 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1cca9d99-974f-4f5e-b47e-47ea525e564e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:56.185046 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1cca9d99-974f-4f5e-b47e-47ea525e564e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:56.185495 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1cca9d99-974f-4f5e-b47e-47ea525e564e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:56.186370 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1cca9d99-974f-4f5e-b47e-47ea525e564e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:56.186806 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1cca9d99-974f-4f5e-b47e-47ea525e564e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:56.316974 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1cca9d99-974f-4f5e-b47e-47ea525e564e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:56.324327 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1cca9d99-974f-4f5e-b47e-47ea525e564e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.151111 Apr 11 14:00:56.324893 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 320/638] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:56 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:56.611430 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-928cd351-a0a4-4a3f-99aa-57adfd906c86 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:56.612016 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-928cd351-a0a4-4a3f-99aa-57adfd906c86 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:56.618204 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-928cd351-a0a4-4a3f-99aa-57adfd906c86 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:56.618656 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-928cd351-a0a4-4a3f-99aa-57adfd906c86 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:56.620341 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-928cd351-a0a4-4a3f-99aa-57adfd906c86 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:56.620889 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-928cd351-a0a4-4a3f-99aa-57adfd906c86 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:56.745994 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-928cd351-a0a4-4a3f-99aa-57adfd906c86 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:56.753238 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-928cd351-a0a4-4a3f-99aa-57adfd906c86 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1673 microversion: 2.1 time: 0.145715 Apr 11 14:00:56.753792 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 319/639] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:56 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:57.341995 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b90999ce-6145-48bb-951c-10c0211a1b8e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:57.342627 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b90999ce-6145-48bb-951c-10c0211a1b8e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:57.349653 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b90999ce-6145-48bb-951c-10c0211a1b8e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:57.350115 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b90999ce-6145-48bb-951c-10c0211a1b8e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:57.351027 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b90999ce-6145-48bb-951c-10c0211a1b8e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:57.351470 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b90999ce-6145-48bb-951c-10c0211a1b8e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:57.584772 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b90999ce-6145-48bb-951c-10c0211a1b8e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:57.592692 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b90999ce-6145-48bb-951c-10c0211a1b8e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.255188 Apr 11 14:00:57.593281 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 321/640] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:57 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:57.770244 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f6f9c03b-13f7-40ae-a7b2-c72d0b6ba377 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:57.770887 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f6f9c03b-13f7-40ae-a7b2-c72d0b6ba377 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:57.777658 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f6f9c03b-13f7-40ae-a7b2-c72d0b6ba377 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:57.778722 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f6f9c03b-13f7-40ae-a7b2-c72d0b6ba377 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:57.779788 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f6f9c03b-13f7-40ae-a7b2-c72d0b6ba377 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:57.780227 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f6f9c03b-13f7-40ae-a7b2-c72d0b6ba377 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:57.941252 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f6f9c03b-13f7-40ae-a7b2-c72d0b6ba377 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:57.954566 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f6f9c03b-13f7-40ae-a7b2-c72d0b6ba377 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1673 microversion: 2.1 time: 0.188081 Apr 11 14:00:57.956022 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 320/641] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:57 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1673 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:58.420922 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-27b9ffbe-ffc2-45a5-86fe-f93de9e7ac64 req-783c4b63-140b-46be-9756-3b7adebdf034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c531fb-df98-4780-bea5-7b483075b4f9", "tag": "99983948-a76f-4e70-b04a-dfb2433aaa98"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:58.429278 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-27b9ffbe-ffc2-45a5-86fe-f93de9e7ac64 req-783c4b63-140b-46be-9756-3b7adebdf034 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:58.430011 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-27b9ffbe-ffc2-45a5-86fe-f93de9e7ac64 req-783c4b63-140b-46be-9756-3b7adebdf034 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:58.441897 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-27b9ffbe-ffc2-45a5-86fe-f93de9e7ac64 req-783c4b63-140b-46be-9756-3b7adebdf034 service nova] Creating event network-changed:99983948-a76f-4e70-b04a-dfb2433aaa98 for instance b1c531fb-df98-4780-bea5-7b483075b4f9 on hv-cinder-83078 Apr 11 14:00:58.449245 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-27b9ffbe-ffc2-45a5-86fe-f93de9e7ac64 req-783c4b63-140b-46be-9756-3b7adebdf034 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106594 Apr 11 14:00:58.450210 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 322/642] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:00:58.609629 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c2ce447c-b269-40f5-9821-c695c22b3d67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:58.610349 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c2ce447c-b269-40f5-9821-c695c22b3d67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:58.616331 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c2ce447c-b269-40f5-9821-c695c22b3d67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:58.616858 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c2ce447c-b269-40f5-9821-c695c22b3d67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:58.617706 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c2ce447c-b269-40f5-9821-c695c22b3d67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:58.618151 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c2ce447c-b269-40f5-9821-c695c22b3d67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:58.746054 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c2ce447c-b269-40f5-9821-c695c22b3d67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:58.753416 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c2ce447c-b269-40f5-9821-c695c22b3d67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.147530 Apr 11 14:00:58.753895 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 321/643] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:58 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:00:58.825414 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c7942a10-65b8-44f2-9983-811d0ada2744 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-92942565"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:00:58.826560 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c7942a10-65b8-44f2-9983-811d0ada2744 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:58.833849 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c7942a10-65b8-44f2-9983-811d0ada2744 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:58.834642 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c7942a10-65b8-44f2-9983-811d0ada2744 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:58.835866 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c7942a10-65b8-44f2-9983-811d0ada2744 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:58.836308 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c7942a10-65b8-44f2-9983-811d0ada2744 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:58.972794 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3fd81148-d7f7-48f8-928d-4106b07bded3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:58.974050 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3fd81148-d7f7-48f8-928d-4106b07bded3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:58.981944 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fd81148-d7f7-48f8-928d-4106b07bded3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:58.982777 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fd81148-d7f7-48f8-928d-4106b07bded3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:58.983867 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fd81148-d7f7-48f8-928d-4106b07bded3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:58.984548 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fd81148-d7f7-48f8-928d-4106b07bded3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:59.065356 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3fd81148-d7f7-48f8-928d-4106b07bded3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:59.073577 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3fd81148-d7f7-48f8-928d-4106b07bded3 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1606 microversion: 2.1 time: 0.104628 Apr 11 14:00:59.083805 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 322/644] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:58 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1606 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:00:59.101937 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.network.security_group_api [None req-c7942a10-65b8-44f2-9983-811d0ada2744 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Removing security group b702b37f-bf09-4495-b518-9860a0ba33cf from port 696c428a-2d32-4149-b9c4-40a4e382593e Apr 11 14:00:59.459197 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c7942a10-65b8-44f2-9983-811d0ada2744 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "POST /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.641058 Apr 11 14:00:59.460595 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 323/645] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 14:00:58 2022] POST /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:00:59.770869 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-93dfb882-0c82-499f-b3fc-67c81b38862e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:00:59.771737 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-93dfb882-0c82-499f-b3fc-67c81b38862e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:00:59.778395 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93dfb882-0c82-499f-b3fc-67c81b38862e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:59.778848 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93dfb882-0c82-499f-b3fc-67c81b38862e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:59.779908 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93dfb882-0c82-499f-b3fc-67c81b38862e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:00:59.780350 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93dfb882-0c82-499f-b3fc-67c81b38862e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:00:59.966007 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-93dfb882-0c82-499f-b3fc-67c81b38862e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:00:59.976119 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-93dfb882-0c82-499f-b3fc-67c81b38862e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.209772 Apr 11 14:00:59.977217 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 323/646] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:00:59 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:00.091243 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-225f81e4-049f-425c-87ea-4c9846112ced tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:00.091906 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-225f81e4-049f-425c-87ea-4c9846112ced tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:00.098235 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-225f81e4-049f-425c-87ea-4c9846112ced tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:00.098762 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-225f81e4-049f-425c-87ea-4c9846112ced tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:00.100056 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-225f81e4-049f-425c-87ea-4c9846112ced tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:00.100578 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-225f81e4-049f-425c-87ea-4c9846112ced tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:00.133532 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-225f81e4-049f-425c-87ea-4c9846112ced tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:00.134095 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-225f81e4-049f-425c-87ea-4c9846112ced tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:00.134623 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-225f81e4-049f-425c-87ea-4c9846112ced tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lazy-loading 'fault' on Instance uuid 54dcdce4-931a-42d3-b36a-321afffabdc0 {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:01:00.427370 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-225f81e4-049f-425c-87ea-4c9846112ced tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:00.435026 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-225f81e4-049f-425c-87ea-4c9846112ced tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 200 len: 1327 microversion: 2.1 time: 0.348576 Apr 11 14:01:00.435598 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 324/647] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:00 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 1327 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:00.475856 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-d0a2bda4-827d-4d0d-af5c-12b774ee760f req-c14f3b04-3a70-4210-81bf-cb98fdd29996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54dcdce4-931a-42d3-b36a-321afffabdc0", "name": "network-vif-deleted", "tag": "73309a92-0432-4081-a050-fdeb449dfc6d"}, {"name": "network-changed", "server_uuid": "79569212-4835-45da-92b0-516e527a1f88", "tag": "696c428a-2d32-4149-b9c4-40a4e382593e"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:00.484973 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-d0a2bda4-827d-4d0d-af5c-12b774ee760f req-c14f3b04-3a70-4210-81bf-cb98fdd29996 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:00.485422 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-d0a2bda4-827d-4d0d-af5c-12b774ee760f req-c14f3b04-3a70-4210-81bf-cb98fdd29996 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:00.498257 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-d0a2bda4-827d-4d0d-af5c-12b774ee760f req-c14f3b04-3a70-4210-81bf-cb98fdd29996 service nova] Creating event network-vif-deleted:73309a92-0432-4081-a050-fdeb449dfc6d for instance 54dcdce4-931a-42d3-b36a-321afffabdc0 on hv-cinder-83078 Apr 11 14:01:00.498761 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-d0a2bda4-827d-4d0d-af5c-12b774ee760f req-c14f3b04-3a70-4210-81bf-cb98fdd29996 service nova] Creating event network-changed:696c428a-2d32-4149-b9c4-40a4e382593e for instance 79569212-4835-45da-92b0-516e527a1f88 on hv-cinder-83078 Apr 11 14:01:00.505243 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-d0a2bda4-827d-4d0d-af5c-12b774ee760f req-c14f3b04-3a70-4210-81bf-cb98fdd29996 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.033253 Apr 11 14:01:00.506066 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 324/648] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:01:00.997343 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-540b8438-4a58-4c55-90d0-d23a37ad3370 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:00.998755 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-540b8438-4a58-4c55-90d0-d23a37ad3370 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:01.006858 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-540b8438-4a58-4c55-90d0-d23a37ad3370 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:01.007449 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-540b8438-4a58-4c55-90d0-d23a37ad3370 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:01.009069 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-540b8438-4a58-4c55-90d0-d23a37ad3370 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:01.009638 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-540b8438-4a58-4c55-90d0-d23a37ad3370 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:01.452957 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-eec63341-6f9a-44cb-8852-ef050dc99bda tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:01.453661 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-eec63341-6f9a-44cb-8852-ef050dc99bda tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:01.459121 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-540b8438-4a58-4c55-90d0-d23a37ad3370 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:01.460266 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eec63341-6f9a-44cb-8852-ef050dc99bda tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:01.460967 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eec63341-6f9a-44cb-8852-ef050dc99bda tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:01.461880 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eec63341-6f9a-44cb-8852-ef050dc99bda tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:01.462545 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eec63341-6f9a-44cb-8852-ef050dc99bda tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:01.467284 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-540b8438-4a58-4c55-90d0-d23a37ad3370 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.477193 Apr 11 14:01:01.467897 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 325/649] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:00 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:01.478540 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-eec63341-6f9a-44cb-8852-ef050dc99bda tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] HTTP exception thrown: Instance 54dcdce4-931a-42d3-b36a-321afffabdc0 could not be found. Apr 11 14:01:01.479864 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-eec63341-6f9a-44cb-8852-ef050dc99bda tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Returning 404 to user: Instance 54dcdce4-931a-42d3-b36a-321afffabdc0 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:01:01.480931 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-eec63341-6f9a-44cb-8852-ef050dc99bda tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 404 len: 111 microversion: 2.1 time: 0.032223 Apr 11 14:01:01.481923 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 325/650] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:01 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 14:01:01.490597 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ac3678c2-e3bd-4dbb-a941-7b1ba6d4ac14 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '.version_select at 0x7f730bb2b820>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:01.508238 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ac3678c2-e3bd-4dbb-a941-7b1ba6d4ac14 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-233368395" status: 202 len: 0 microversion: 2.1 time: 0.021622 Apr 11 14:01:01.508824 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 326/651] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Apr 11 14:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-233368395 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:01:01.761316 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-21a269cb-d835-48b6-ac6d-1fd0067bf618 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:01.761811 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-21a269cb-d835-48b6-ac6d-1fd0067bf618 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:01.768778 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-21a269cb-d835-48b6-ac6d-1fd0067bf618 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:01.769235 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-21a269cb-d835-48b6-ac6d-1fd0067bf618 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:01.770199 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-21a269cb-d835-48b6-ac6d-1fd0067bf618 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:01.770920 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-21a269cb-d835-48b6-ac6d-1fd0067bf618 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:01.871340 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-21a269cb-d835-48b6-ac6d-1fd0067bf618 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lazy-loading 'services' on Instance uuid 79569212-4835-45da-92b0-516e527a1f88 {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:01:01.958260 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-21a269cb-d835-48b6-ac6d-1fd0067bf618 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "DELETE /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/os-volume_attachments/20704b97-578c-4eac-a369-1ca0c46dc5f2" status: 202 len: 0 microversion: 2.1 time: 0.201128 Apr 11 14:01:01.959555 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 326/652] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Apr 11 14:01:01 2022] DELETE /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/os-volume_attachments/20704b97-578c-4eac-a369-1ca0c46dc5f2 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:01:01.969727 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-94a1d72d-7cb1-48c4-90d1-8c0fb03f93eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:01.978181 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-94a1d72d-7cb1-48c4-90d1-8c0fb03f93eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:01.988334 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-94a1d72d-7cb1-48c4-90d1-8c0fb03f93eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:01.989004 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-94a1d72d-7cb1-48c4-90d1-8c0fb03f93eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:01.990026 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-94a1d72d-7cb1-48c4-90d1-8c0fb03f93eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:01.990666 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-94a1d72d-7cb1-48c4-90d1-8c0fb03f93eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:02.046269 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-94a1d72d-7cb1-48c4-90d1-8c0fb03f93eb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081936 Apr 11 14:01:02.048432 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 327/653] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:01:01 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:01:02.249910 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-99296cba-5963-4bc1-bf5f-362bcb6829fc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Action: 'create', calling method: .version_select at 0x7f73069a91f0>, body: {"keypair": {"name": "tempest-keypair-2028920529"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:02.264806 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-99296cba-5963-4bc1-bf5f-362bcb6829fc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Getting quotas for project f8720d1d0e26443d96a5f29175402af6. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:01:02.269104 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-99296cba-5963-4bc1-bf5f-362bcb6829fc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Getting quotas for user 1bcde529b708471eb9c1b74e15b588b7 and project f8720d1d0e26443d96a5f29175402af6. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:01:02.487012 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0ede044e-a2ea-4039-a453-93e52530f55b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:02.488586 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0ede044e-a2ea-4039-a453-93e52530f55b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:02.497211 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ede044e-a2ea-4039-a453-93e52530f55b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:02.498135 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ede044e-a2ea-4039-a453-93e52530f55b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:02.499778 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ede044e-a2ea-4039-a453-93e52530f55b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:02.500441 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ede044e-a2ea-4039-a453-93e52530f55b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:02.657289 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0ede044e-a2ea-4039-a453-93e52530f55b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:02.666756 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0ede044e-a2ea-4039-a453-93e52530f55b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.185498 Apr 11 14:01:02.675853 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 328/654] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:02 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:02.675853 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-819c230c-7ea6-4467-8492-796d0e06e1c1 req-63a4628f-2751-42bb-8d04-185cd7790747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79569212-4835-45da-92b0-516e527a1f88", "tag": "696c428a-2d32-4149-b9c4-40a4e382593e"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:02.684147 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-819c230c-7ea6-4467-8492-796d0e06e1c1 req-63a4628f-2751-42bb-8d04-185cd7790747 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:02.688155 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-819c230c-7ea6-4467-8492-796d0e06e1c1 req-63a4628f-2751-42bb-8d04-185cd7790747 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:02.707492 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-819c230c-7ea6-4467-8492-796d0e06e1c1 req-63a4628f-2751-42bb-8d04-185cd7790747 service nova] Creating event network-changed:696c428a-2d32-4149-b9c4-40a4e382593e for instance 79569212-4835-45da-92b0-516e527a1f88 on hv-cinder-83078 Apr 11 14:01:02.715324 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-819c230c-7ea6-4467-8492-796d0e06e1c1 req-63a4628f-2751-42bb-8d04-185cd7790747 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046242 Apr 11 14:01:02.716366 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 329/655] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:01:02.914164 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-99296cba-5963-4bc1-bf5f-362bcb6829fc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Getting quotas for project f8720d1d0e26443d96a5f29175402af6. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:01:02.919122 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-99296cba-5963-4bc1-bf5f-362bcb6829fc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Getting quotas for user 1bcde529b708471eb9c1b74e15b588b7 and project f8720d1d0e26443d96a5f29175402af6. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:01:02.933881 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-99296cba-5963-4bc1-bf5f-362bcb6829fc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.688254 Apr 11 14:01:02.934664 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 327/656] 10.222.0.67 () {60 vars in 1157 bytes} [Mon Apr 11 14:01:02 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:03.060421 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e6d302f5-fc86-42af-a6dd-b79a0a6a5bfb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:03.062181 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e6d302f5-fc86-42af-a6dd-b79a0a6a5bfb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:03.070338 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e6d302f5-fc86-42af-a6dd-b79a0a6a5bfb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:03.071209 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e6d302f5-fc86-42af-a6dd-b79a0a6a5bfb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:03.072247 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e6d302f5-fc86-42af-a6dd-b79a0a6a5bfb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:03.072878 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e6d302f5-fc86-42af-a6dd-b79a0a6a5bfb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:03.107046 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e6d302f5-fc86-42af-a6dd-b79a0a6a5bfb tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052054 Apr 11 14:01:03.107866 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 330/657] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:01:03 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 14:01:03.118261 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-89045c3c-0bb5-4036-8b58-d6d38668d495 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:03.118933 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-89045c3c-0bb5-4036-8b58-d6d38668d495 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:03.126162 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89045c3c-0bb5-4036-8b58-d6d38668d495 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:03.126627 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89045c3c-0bb5-4036-8b58-d6d38668d495 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:03.127415 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89045c3c-0bb5-4036-8b58-d6d38668d495 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:03.127893 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89045c3c-0bb5-4036-8b58-d6d38668d495 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:03.212046 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-89045c3c-0bb5-4036-8b58-d6d38668d495 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] HTTP exception thrown: Instance 79569212-4835-45da-92b0-516e527a1f88 is not attached to volume 20704b97-578c-4eac-a369-1ca0c46dc5f2 Apr 11 14:01:03.212753 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-89045c3c-0bb5-4036-8b58-d6d38668d495 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Returning 404 to user: Instance 79569212-4835-45da-92b0-516e527a1f88 is not attached to volume 20704b97-578c-4eac-a369-1ca0c46dc5f2 {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:01:03.213723 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-89045c3c-0bb5-4036-8b58-d6d38668d495 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "DELETE /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/os-volume_attachments/20704b97-578c-4eac-a369-1ca0c46dc5f2" status: 404 len: 154 microversion: 2.1 time: 0.100020 Apr 11 14:01:03.214372 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 328/658] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Apr 11 14:01:03 2022] DELETE /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88/os-volume_attachments/20704b97-578c-4eac-a369-1ca0c46dc5f2 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:01:03.683262 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e91bf819-f32d-47fc-8bc6-ba6f542a0143 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:03.683912 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e91bf819-f32d-47fc-8bc6-ba6f542a0143 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:03.690661 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e91bf819-f32d-47fc-8bc6-ba6f542a0143 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:03.691226 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e91bf819-f32d-47fc-8bc6-ba6f542a0143 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:03.692100 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e91bf819-f32d-47fc-8bc6-ba6f542a0143 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:03.692635 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e91bf819-f32d-47fc-8bc6-ba6f542a0143 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:03.832862 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e91bf819-f32d-47fc-8bc6-ba6f542a0143 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:03.841336 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e91bf819-f32d-47fc-8bc6-ba6f542a0143 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.161840 Apr 11 14:01:03.842663 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 331/659] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:03 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:03.904996 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-edbc25f6-433a-454c-b0fc-6143321467c2 req-2e9a3c12-9c62-4536-9759-40ec48512a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c531fb-df98-4780-bea5-7b483075b4f9", "name": "network-vif-plugged", "status": "completed", "tag": "99983948-a76f-4e70-b04a-dfb2433aaa98"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:03.915309 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-edbc25f6-433a-454c-b0fc-6143321467c2 req-2e9a3c12-9c62-4536-9759-40ec48512a3a service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:03.915957 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-edbc25f6-433a-454c-b0fc-6143321467c2 req-2e9a3c12-9c62-4536-9759-40ec48512a3a service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:03.926308 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-edbc25f6-433a-454c-b0fc-6143321467c2 req-2e9a3c12-9c62-4536-9759-40ec48512a3a service nova] Creating event network-vif-plugged:99983948-a76f-4e70-b04a-dfb2433aaa98 for instance b1c531fb-df98-4780-bea5-7b483075b4f9 on hv-cinder-83078 Apr 11 14:01:03.931170 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-edbc25f6-433a-454c-b0fc-6143321467c2 req-2e9a3c12-9c62-4536-9759-40ec48512a3a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104643 Apr 11 14:01:03.931857 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 329/660] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:01:04.270065 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-509380891", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "257d7092-c4df-47e4-abc9-31af4018d257"}], "security_groups": [{"name": "tempest-securitygroup--1778572492"}], "key_name": "tempest-keypair-2028920529", "user_data": "}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:04.367747 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] validate_networks() for [('257d7092-c4df-47e4-abc9-31af4018d257', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 14:01:04.371715 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-66fb93ad-cf2b-4e80-8956-58f3fdcd32ad tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:04.372472 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-66fb93ad-cf2b-4e80-8956-58f3fdcd32ad tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:04.378612 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-66fb93ad-cf2b-4e80-8956-58f3fdcd32ad tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:04.379064 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-66fb93ad-cf2b-4e80-8956-58f3fdcd32ad tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:04.379876 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-66fb93ad-cf2b-4e80-8956-58f3fdcd32ad tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:04.380316 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-66fb93ad-cf2b-4e80-8956-58f3fdcd32ad tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:04.405146 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-66fb93ad-cf2b-4e80-8956-58f3fdcd32ad tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:01:04.480319 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-66fb93ad-cf2b-4e80-8956-58f3fdcd32ad tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "DELETE /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 204 len: 0 microversion: 2.1 time: 0.113088 Apr 11 14:01:04.480909 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 330/661] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:01:04 2022] DELETE /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 14:01:04.489877 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6007cec7-18e2-4c5b-af79-50b1754be51d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:04.490591 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6007cec7-18e2-4c5b-af79-50b1754be51d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:04.496817 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6007cec7-18e2-4c5b-af79-50b1754be51d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:04.497316 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6007cec7-18e2-4c5b-af79-50b1754be51d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:04.498118 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6007cec7-18e2-4c5b-af79-50b1754be51d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:04.498582 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6007cec7-18e2-4c5b-af79-50b1754be51d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:04.631069 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6007cec7-18e2-4c5b-af79-50b1754be51d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:04.638375 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6007cec7-18e2-4c5b-af79-50b1754be51d tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1554 microversion: 2.1 time: 0.152612 Apr 11 14:01:04.638950 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 331/662] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:04 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:04.746260 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 14:01:04.746688 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 14:01:04.747167 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 14:01:04.747606 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 14:01:04.748084 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 14:01:04.757200 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:04.757651 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:04.758453 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:04.758888 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:04.774720 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Getting quotas for project f8720d1d0e26443d96a5f29175402af6. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:01:04.778948 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Getting quotas for user 1bcde529b708471eb9c1b74e15b588b7 and project f8720d1d0e26443d96a5f29175402af6. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:01:04.789527 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 14:01:04.792505 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 14:01:04.836718 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f5712b9b-02b3-4cfd-8796-64efd4c04064 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.570785 Apr 11 14:01:04.837366 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 332/663] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 14:01:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 14:01:04.847376 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9e38bd7a-a7f1-4de9-8ec1-06445dfd5b25 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:04.848018 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9e38bd7a-a7f1-4de9-8ec1-06445dfd5b25 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:04.858781 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-51dbb6b5-59a6-4e5b-988f-5e837bd90892 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:04.859400 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-51dbb6b5-59a6-4e5b-988f-5e837bd90892 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:04.865784 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-51dbb6b5-59a6-4e5b-988f-5e837bd90892 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:04.866371 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-51dbb6b5-59a6-4e5b-988f-5e837bd90892 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:04.867006 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-51dbb6b5-59a6-4e5b-988f-5e837bd90892 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:04.867442 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-51dbb6b5-59a6-4e5b-988f-5e837bd90892 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:04.903417 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9e38bd7a-a7f1-4de9-8ec1-06445dfd5b25 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:04.910837 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9e38bd7a-a7f1-4de9-8ec1-06445dfd5b25 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1237 microversion: 2.1 time: 0.066542 Apr 11 14:01:04.911813 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 332/664] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:04 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:05.004682 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-51dbb6b5-59a6-4e5b-988f-5e837bd90892 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:05.012399 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-51dbb6b5-59a6-4e5b-988f-5e837bd90892 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.157417 Apr 11 14:01:05.012993 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 333/665] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:04 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:05.437407 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-14824d75-570b-49e9-80cd-837153a09b81 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:05.437913 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-14824d75-570b-49e9-80cd-837153a09b81 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:05.444219 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-14824d75-570b-49e9-80cd-837153a09b81 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:05.444683 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-14824d75-570b-49e9-80cd-837153a09b81 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:05.445463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-14824d75-570b-49e9-80cd-837153a09b81 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:05.445911 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-14824d75-570b-49e9-80cd-837153a09b81 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:05.468722 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-14824d75-570b-49e9-80cd-837153a09b81 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/ips" status: 200 len: 151 microversion: 2.20 time: 0.128653 Apr 11 14:01:05.469277 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 333/666] 10.222.0.67 () {60 vars in 1288 bytes} [Mon Apr 11 14:01:05 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/ips => generated 151 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 14:01:05.655603 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b689adb5-f8b5-4759-bb2a-269ede651e69 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:05.656342 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b689adb5-f8b5-4759-bb2a-269ede651e69 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:05.668817 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b689adb5-f8b5-4759-bb2a-269ede651e69 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:05.669395 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b689adb5-f8b5-4759-bb2a-269ede651e69 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:05.670325 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b689adb5-f8b5-4759-bb2a-269ede651e69 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:05.670993 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b689adb5-f8b5-4759-bb2a-269ede651e69 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:05.799912 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b689adb5-f8b5-4759-bb2a-269ede651e69 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:05.807873 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b689adb5-f8b5-4759-bb2a-269ede651e69 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1554 microversion: 2.1 time: 0.156382 Apr 11 14:01:05.808440 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 334/667] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:05 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:05.928350 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8788ca08-3586-4b5d-aa81-eb0b1bce3b70 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:05.928902 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8788ca08-3586-4b5d-aa81-eb0b1bce3b70 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:05.935867 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8788ca08-3586-4b5d-aa81-eb0b1bce3b70 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:05.936329 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8788ca08-3586-4b5d-aa81-eb0b1bce3b70 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:05.937131 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8788ca08-3586-4b5d-aa81-eb0b1bce3b70 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:05.937578 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8788ca08-3586-4b5d-aa81-eb0b1bce3b70 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:05.998407 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8788ca08-3586-4b5d-aa81-eb0b1bce3b70 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:06.006124 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8788ca08-3586-4b5d-aa81-eb0b1bce3b70 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1241 microversion: 2.1 time: 0.081795 Apr 11 14:01:06.006700 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 334/668] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:05 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:06.029723 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4b6f556a-d647-4f63-9529-67fabb5c2de6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:06.030338 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4b6f556a-d647-4f63-9529-67fabb5c2de6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:06.036355 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b6f556a-d647-4f63-9529-67fabb5c2de6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:06.036809 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b6f556a-d647-4f63-9529-67fabb5c2de6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:06.037573 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b6f556a-d647-4f63-9529-67fabb5c2de6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:06.038011 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b6f556a-d647-4f63-9529-67fabb5c2de6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:06.168502 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4b6f556a-d647-4f63-9529-67fabb5c2de6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:06.175618 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4b6f556a-d647-4f63-9529-67fabb5c2de6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.150241 Apr 11 14:01:06.176212 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 335/669] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:06 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:06.825385 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-afbe2516-4ba0-4144-bc82-2479031790bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:06.826694 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-afbe2516-4ba0-4144-bc82-2479031790bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:06.833682 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-afbe2516-4ba0-4144-bc82-2479031790bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:06.834195 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-afbe2516-4ba0-4144-bc82-2479031790bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:06.834971 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-afbe2516-4ba0-4144-bc82-2479031790bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:06.835416 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-afbe2516-4ba0-4144-bc82-2479031790bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:06.964847 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-afbe2516-4ba0-4144-bc82-2479031790bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d95fb42f294675a9e9bb5f03304390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644547f80e2543079781f0c7b34c40b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:06.972373 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-afbe2516-4ba0-4144-bc82-2479031790bd tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 200 len: 1554 microversion: 2.1 time: 0.151234 Apr 11 14:01:06.972881 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 335/670] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:06 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:07.023852 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a479fa0e-a8dd-4312-acca-1a2df5b729e8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:07.024578 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a479fa0e-a8dd-4312-acca-1a2df5b729e8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:07.032238 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a479fa0e-a8dd-4312-acca-1a2df5b729e8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:07.032686 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a479fa0e-a8dd-4312-acca-1a2df5b729e8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:07.033446 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a479fa0e-a8dd-4312-acca-1a2df5b729e8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:07.033893 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a479fa0e-a8dd-4312-acca-1a2df5b729e8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:07.102379 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a479fa0e-a8dd-4312-acca-1a2df5b729e8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:07.110575 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a479fa0e-a8dd-4312-acca-1a2df5b729e8 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1297 microversion: 2.1 time: 0.090746 Apr 11 14:01:07.112129 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 336/671] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:07 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:07.194451 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-68deb99a-4037-40a6-a36c-18d931ee6264 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:07.195385 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-68deb99a-4037-40a6-a36c-18d931ee6264 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:07.203054 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-68deb99a-4037-40a6-a36c-18d931ee6264 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:07.203696 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-68deb99a-4037-40a6-a36c-18d931ee6264 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:07.204643 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-68deb99a-4037-40a6-a36c-18d931ee6264 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:07.205305 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-68deb99a-4037-40a6-a36c-18d931ee6264 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:07.213323 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-acbfbbc7-16c7-451b-8cc3-d940f7cd5904 req-1c56781c-7c9b-41d0-9495-2b2b4f236edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79569212-4835-45da-92b0-516e527a1f88", "name": "network-vif-deleted", "tag": "696c428a-2d32-4149-b9c4-40a4e382593e"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:07.225890 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-acbfbbc7-16c7-451b-8cc3-d940f7cd5904 req-1c56781c-7c9b-41d0-9495-2b2b4f236edf service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:07.226644 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-acbfbbc7-16c7-451b-8cc3-d940f7cd5904 req-1c56781c-7c9b-41d0-9495-2b2b4f236edf service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:07.247699 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-acbfbbc7-16c7-451b-8cc3-d940f7cd5904 req-1c56781c-7c9b-41d0-9495-2b2b4f236edf service nova] Creating event network-vif-deleted:696c428a-2d32-4149-b9c4-40a4e382593e for instance 79569212-4835-45da-92b0-516e527a1f88 on hv-cinder-83078 Apr 11 14:01:07.254537 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-acbfbbc7-16c7-451b-8cc3-d940f7cd5904 req-1c56781c-7c9b-41d0-9495-2b2b4f236edf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046227 Apr 11 14:01:07.255790 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 337/672] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:01:07.369660 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-68deb99a-4037-40a6-a36c-18d931ee6264 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:07.378434 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-68deb99a-4037-40a6-a36c-18d931ee6264 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1558 microversion: 2.1 time: 0.189286 Apr 11 14:01:07.379682 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 336/673] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:07 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1558 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:07.397794 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-857ac8dd-f41b-4251-906e-eb8697f07bfd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:07.398438 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-857ac8dd-f41b-4251-906e-eb8697f07bfd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:07.405691 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-857ac8dd-f41b-4251-906e-eb8697f07bfd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:07.406139 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-857ac8dd-f41b-4251-906e-eb8697f07bfd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:07.406903 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-857ac8dd-f41b-4251-906e-eb8697f07bfd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:07.407334 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-857ac8dd-f41b-4251-906e-eb8697f07bfd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:07.429457 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-26f887ac-fefc-424b-b0be-0921d3ffaf12 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:07.430001 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-26f887ac-fefc-424b-b0be-0921d3ffaf12 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:07.436375 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26f887ac-fefc-424b-b0be-0921d3ffaf12 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:07.436828 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26f887ac-fefc-424b-b0be-0921d3ffaf12 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:07.437601 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26f887ac-fefc-424b-b0be-0921d3ffaf12 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:07.438053 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26f887ac-fefc-424b-b0be-0921d3ffaf12 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:07.461010 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-26f887ac-fefc-424b-b0be-0921d3ffaf12 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lazy-loading 'flavor' on Instance uuid cf497683-01c3-4106-adb0-36d23d564607 {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:01:07.512532 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-857ac8dd-f41b-4251-906e-eb8697f07bfd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119788 Apr 11 14:01:07.513559 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 338/674] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Apr 11 14:01:07 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:01:07.780265 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-26f887ac-fefc-424b-b0be-0921d3ffaf12 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "POST /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/action" status: 202 len: 0 microversion: 2.20 time: 0.354181 Apr 11 14:01:07.781238 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 337/675] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Apr 11 14:01:07 2022] POST /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 11 14:01:07.795216 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-78aa4d6e-47e5-4430-9506-f4b7a555c471 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:07.799027 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-78aa4d6e-47e5-4430-9506-f4b7a555c471 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:07.814983 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78aa4d6e-47e5-4430-9506-f4b7a555c471 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:07.816022 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78aa4d6e-47e5-4430-9506-f4b7a555c471 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:07.817971 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78aa4d6e-47e5-4430-9506-f4b7a555c471 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:07.818662 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78aa4d6e-47e5-4430-9506-f4b7a555c471 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:07.990578 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1f8e71da-2fd9-49e2-83f7-6b3f6d29687f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:07.991426 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1f8e71da-2fd9-49e2-83f7-6b3f6d29687f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] [instance: 79569212-4835-45da-92b0-516e527a1f88] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:07.998518 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f8e71da-2fd9-49e2-83f7-6b3f6d29687f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:07.999100 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f8e71da-2fd9-49e2-83f7-6b3f6d29687f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:08.000375 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f8e71da-2fd9-49e2-83f7-6b3f6d29687f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:08.000981 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f8e71da-2fd9-49e2-83f7-6b3f6d29687f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:08.018020 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-1f8e71da-2fd9-49e2-83f7-6b3f6d29687f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] HTTP exception thrown: Instance 79569212-4835-45da-92b0-516e527a1f88 could not be found. Apr 11 14:01:08.018634 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1f8e71da-2fd9-49e2-83f7-6b3f6d29687f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Returning 404 to user: Instance 79569212-4835-45da-92b0-516e527a1f88 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:01:08.019499 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1f8e71da-2fd9-49e2-83f7-6b3f6d29687f tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88" status: 404 len: 111 microversion: 2.1 time: 0.033913 Apr 11 14:01:08.020504 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 338/676] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:07 2022] GET /compute/v2.1/servers/79569212-4835-45da-92b0-516e527a1f88 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 14:01:08.032568 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-48c79b3d-2e40-45aa-8c79-eda32e601a52 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] Calling method '.version_select at 0x7f73068aa3a0>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:08.054252 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-48c79b3d-2e40-45aa-8c79-eda32e601a52 tempest-TestMinimumBasicScenario-1408592018 tempest-TestMinimumBasicScenario-1408592018-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1803271748" status: 202 len: 0 microversion: 2.1 time: 0.026291 Apr 11 14:01:08.055144 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 339/677] 10.222.0.67 () {58 vars in 1271 bytes} [Mon Apr 11 14:01:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1803271748 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 14:01:08.132585 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cb1594ad-5898-4a5b-9e8d-e094a13fe5e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:08.134819 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cb1594ad-5898-4a5b-9e8d-e094a13fe5e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:08.144342 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb1594ad-5898-4a5b-9e8d-e094a13fe5e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:08.145201 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb1594ad-5898-4a5b-9e8d-e094a13fe5e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:08.146488 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb1594ad-5898-4a5b-9e8d-e094a13fe5e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:08.147154 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb1594ad-5898-4a5b-9e8d-e094a13fe5e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:08.252420 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cb1594ad-5898-4a5b-9e8d-e094a13fe5e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:08.262867 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cb1594ad-5898-4a5b-9e8d-e094a13fe5e6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1295 microversion: 2.1 time: 0.135412 Apr 11 14:01:08.262867 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 340/678] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:08 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1295 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:08.356470 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-78aa4d6e-47e5-4430-9506-f4b7a555c471 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:08.374342 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-78aa4d6e-47e5-4430-9506-f4b7a555c471 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:08.382301 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-78aa4d6e-47e5-4430-9506-f4b7a555c471 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:08.383936 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-78aa4d6e-47e5-4430-9506-f4b7a555c471 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.597973 Apr 11 14:01:08.403350 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 339/679] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:07 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:09.119909 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-d4e54730-b152-47b3-bb49-bf654d7e4ddd req-aa35ffe4-985b-42a9-a756-d30989d76bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c531fb-df98-4780-bea5-7b483075b4f9", "tag": "99983948-a76f-4e70-b04a-dfb2433aaa98"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:09.128022 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-d4e54730-b152-47b3-bb49-bf654d7e4ddd req-aa35ffe4-985b-42a9-a756-d30989d76bc5 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:09.128474 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-d4e54730-b152-47b3-bb49-bf654d7e4ddd req-aa35ffe4-985b-42a9-a756-d30989d76bc5 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:09.140316 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-d4e54730-b152-47b3-bb49-bf654d7e4ddd req-aa35ffe4-985b-42a9-a756-d30989d76bc5 service nova] Creating event network-changed:99983948-a76f-4e70-b04a-dfb2433aaa98 for instance b1c531fb-df98-4780-bea5-7b483075b4f9 on hv-cinder-83078 Apr 11 14:01:09.146000 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-d4e54730-b152-47b3-bb49-bf654d7e4ddd req-aa35ffe4-985b-42a9-a756-d30989d76bc5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090982 Apr 11 14:01:09.147497 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 341/680] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:01:09.281527 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-29cf56a2-d182-4cb5-893a-04dfec68d9dc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:09.282255 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-29cf56a2-d182-4cb5-893a-04dfec68d9dc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:09.289701 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29cf56a2-d182-4cb5-893a-04dfec68d9dc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:09.290503 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29cf56a2-d182-4cb5-893a-04dfec68d9dc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:09.291914 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29cf56a2-d182-4cb5-893a-04dfec68d9dc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:09.293040 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29cf56a2-d182-4cb5-893a-04dfec68d9dc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:09.405365 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-45250723-adf0-4997-89ae-0d315f536206 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:09.406464 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-45250723-adf0-4997-89ae-0d315f536206 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:09.413344 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-45250723-adf0-4997-89ae-0d315f536206 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:09.413889 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-45250723-adf0-4997-89ae-0d315f536206 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:09.414804 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-45250723-adf0-4997-89ae-0d315f536206 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:09.415313 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-45250723-adf0-4997-89ae-0d315f536206 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:09.556156 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-45250723-adf0-4997-89ae-0d315f536206 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:09.567118 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-45250723-adf0-4997-89ae-0d315f536206 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:09.568831 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-45250723-adf0-4997-89ae-0d315f536206 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:09.570744 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-45250723-adf0-4997-89ae-0d315f536206 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.170669 Apr 11 14:01:09.571545 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 342/681] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:09 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:09.767012 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-29cf56a2-d182-4cb5-893a-04dfec68d9dc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:09.776440 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-29cf56a2-d182-4cb5-893a-04dfec68d9dc tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1363 microversion: 2.1 time: 0.499463 Apr 11 14:01:09.782954 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 340/682] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:09 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1363 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:10.034346 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-23ef5a47-a4f8-4914-97f4-879e3c2e7e7d req-73382210-1112-4baa-bec1-1470781371ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2990320-e015-4b65-9175-4b875d4142fd", "tag": "26a6c2cb-0c2f-44e9-812a-19d9f51501fe"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:10.046172 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-23ef5a47-a4f8-4914-97f4-879e3c2e7e7d req-73382210-1112-4baa-bec1-1470781371ec service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:10.046620 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-23ef5a47-a4f8-4914-97f4-879e3c2e7e7d req-73382210-1112-4baa-bec1-1470781371ec service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:10.084420 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-23ef5a47-a4f8-4914-97f4-879e3c2e7e7d req-73382210-1112-4baa-bec1-1470781371ec service nova] Creating event network-changed:26a6c2cb-0c2f-44e9-812a-19d9f51501fe for instance c2990320-e015-4b65-9175-4b875d4142fd on hv-cinder-83078 Apr 11 14:01:10.090015 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-23ef5a47-a4f8-4914-97f4-879e3c2e7e7d req-73382210-1112-4baa-bec1-1470781371ec service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060670 Apr 11 14:01:10.091032 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 343/683] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:01:10.590926 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-71d4775c-80f0-4366-a990-21041e2123ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:10.591489 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-71d4775c-80f0-4366-a990-21041e2123ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:10.597909 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71d4775c-80f0-4366-a990-21041e2123ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:10.598364 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71d4775c-80f0-4366-a990-21041e2123ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:10.599145 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71d4775c-80f0-4366-a990-21041e2123ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:10.599579 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71d4775c-80f0-4366-a990-21041e2123ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:10.798903 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ab51bc3b-edbf-41ce-b9b0-5a683e133480 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:10.799609 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ab51bc3b-edbf-41ce-b9b0-5a683e133480 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:10.805580 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ab51bc3b-edbf-41ce-b9b0-5a683e133480 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:10.806654 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ab51bc3b-edbf-41ce-b9b0-5a683e133480 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:10.807499 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ab51bc3b-edbf-41ce-b9b0-5a683e133480 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:10.807971 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ab51bc3b-edbf-41ce-b9b0-5a683e133480 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:10.934259 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ab51bc3b-edbf-41ce-b9b0-5a683e133480 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:10.941582 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ab51bc3b-edbf-41ce-b9b0-5a683e133480 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1363 microversion: 2.1 time: 0.146939 Apr 11 14:01:10.942237 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 344/684] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:10 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:10.956439 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-71d4775c-80f0-4366-a990-21041e2123ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:10.964548 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-71d4775c-80f0-4366-a990-21041e2123ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:10.966436 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-71d4775c-80f0-4366-a990-21041e2123ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:10.967723 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-71d4775c-80f0-4366-a990-21041e2123ba tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.382204 Apr 11 14:01:10.968365 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 341/685] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:10 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:11.958645 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-504fc8b3-5282-4500-a1bd-47b3de7fc20b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:11.959391 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-504fc8b3-5282-4500-a1bd-47b3de7fc20b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:11.966697 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-504fc8b3-5282-4500-a1bd-47b3de7fc20b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:11.967325 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-504fc8b3-5282-4500-a1bd-47b3de7fc20b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:11.968462 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-504fc8b3-5282-4500-a1bd-47b3de7fc20b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:11.969006 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-504fc8b3-5282-4500-a1bd-47b3de7fc20b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:11.986288 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9e235392-d051-4c3a-8b2b-92adec92a81f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:11.987501 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9e235392-d051-4c3a-8b2b-92adec92a81f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:12.001424 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e235392-d051-4c3a-8b2b-92adec92a81f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:12.002912 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e235392-d051-4c3a-8b2b-92adec92a81f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:12.016861 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e235392-d051-4c3a-8b2b-92adec92a81f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:12.018132 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e235392-d051-4c3a-8b2b-92adec92a81f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:12.133674 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-504fc8b3-5282-4500-a1bd-47b3de7fc20b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:12.142770 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-504fc8b3-5282-4500-a1bd-47b3de7fc20b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1363 microversion: 2.1 time: 0.188222 Apr 11 14:01:12.151999 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 345/686] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:11 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:12.293425 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9e235392-d051-4c3a-8b2b-92adec92a81f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:12.301317 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9e235392-d051-4c3a-8b2b-92adec92a81f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:12.302834 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9e235392-d051-4c3a-8b2b-92adec92a81f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:12.304243 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9e235392-d051-4c3a-8b2b-92adec92a81f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.322982 Apr 11 14:01:12.305329 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 342/687] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:11 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:13.161066 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-47531320-e3f9-43f1-959d-f6cff61bc23b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:13.161691 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-47531320-e3f9-43f1-959d-f6cff61bc23b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:13.168942 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47531320-e3f9-43f1-959d-f6cff61bc23b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:13.169407 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47531320-e3f9-43f1-959d-f6cff61bc23b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:13.170197 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47531320-e3f9-43f1-959d-f6cff61bc23b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:13.170644 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47531320-e3f9-43f1-959d-f6cff61bc23b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:13.309958 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-47531320-e3f9-43f1-959d-f6cff61bc23b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:13.318842 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-47531320-e3f9-43f1-959d-f6cff61bc23b tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1363 microversion: 2.1 time: 0.162163 Apr 11 14:01:13.320267 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 346/688] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:13 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:13.324345 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f02c3acc-bdd1-4479-b13c-a9b5d909fc57 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:13.326410 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f02c3acc-bdd1-4479-b13c-a9b5d909fc57 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:13.334302 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f02c3acc-bdd1-4479-b13c-a9b5d909fc57 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:13.336068 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f02c3acc-bdd1-4479-b13c-a9b5d909fc57 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:13.340951 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f02c3acc-bdd1-4479-b13c-a9b5d909fc57 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:13.341411 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f02c3acc-bdd1-4479-b13c-a9b5d909fc57 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:13.500551 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f02c3acc-bdd1-4479-b13c-a9b5d909fc57 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:13.509370 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f02c3acc-bdd1-4479-b13c-a9b5d909fc57 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:13.511006 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f02c3acc-bdd1-4479-b13c-a9b5d909fc57 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:13.512298 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f02c3acc-bdd1-4479-b13c-a9b5d909fc57 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.193570 Apr 11 14:01:13.512894 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 343/689] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:13 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:01:14.336711 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b26de274-cdea-499d-9e8d-3f259f5a3943 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:14.337429 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b26de274-cdea-499d-9e8d-3f259f5a3943 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:14.343897 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b26de274-cdea-499d-9e8d-3f259f5a3943 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:14.344362 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b26de274-cdea-499d-9e8d-3f259f5a3943 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:14.345150 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b26de274-cdea-499d-9e8d-3f259f5a3943 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:14.345791 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b26de274-cdea-499d-9e8d-3f259f5a3943 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:14.488899 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b26de274-cdea-499d-9e8d-3f259f5a3943 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:14.496759 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b26de274-cdea-499d-9e8d-3f259f5a3943 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1363 microversion: 2.1 time: 0.163899 Apr 11 14:01:14.497359 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 347/690] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:14 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:14.530940 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4bbbd271-a101-4aaa-8f9a-d7233905c6f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:14.531566 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4bbbd271-a101-4aaa-8f9a-d7233905c6f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:14.538270 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4bbbd271-a101-4aaa-8f9a-d7233905c6f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:14.538725 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4bbbd271-a101-4aaa-8f9a-d7233905c6f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:14.539512 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4bbbd271-a101-4aaa-8f9a-d7233905c6f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:14.540498 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4bbbd271-a101-4aaa-8f9a-d7233905c6f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:14.830384 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4bbbd271-a101-4aaa-8f9a-d7233905c6f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:14.838650 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4bbbd271-a101-4aaa-8f9a-d7233905c6f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:14.840173 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4bbbd271-a101-4aaa-8f9a-d7233905c6f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:14.841352 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4bbbd271-a101-4aaa-8f9a-d7233905c6f6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.314640 Apr 11 14:01:14.841914 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 344/691] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:14 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:15.513073 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0134d9e0-0642-4a93-9d73-954cc477a639 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:15.513620 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0134d9e0-0642-4a93-9d73-954cc477a639 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:15.519846 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0134d9e0-0642-4a93-9d73-954cc477a639 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:15.520302 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0134d9e0-0642-4a93-9d73-954cc477a639 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:15.521072 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0134d9e0-0642-4a93-9d73-954cc477a639 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:15.521514 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0134d9e0-0642-4a93-9d73-954cc477a639 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:15.705664 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0134d9e0-0642-4a93-9d73-954cc477a639 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:15.714053 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0134d9e0-0642-4a93-9d73-954cc477a639 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1363 microversion: 2.1 time: 0.204898 Apr 11 14:01:15.714828 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 348/692] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:15 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:15.859273 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b40929d1-47e9-45a2-bc85-2629f76226b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:15.859982 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b40929d1-47e9-45a2-bc85-2629f76226b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:15.866038 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b40929d1-47e9-45a2-bc85-2629f76226b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:15.866503 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b40929d1-47e9-45a2-bc85-2629f76226b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:15.867260 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b40929d1-47e9-45a2-bc85-2629f76226b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:15.867717 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b40929d1-47e9-45a2-bc85-2629f76226b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:16.022677 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b40929d1-47e9-45a2-bc85-2629f76226b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:16.033499 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b40929d1-47e9-45a2-bc85-2629f76226b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:16.035547 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b40929d1-47e9-45a2-bc85-2629f76226b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:16.036759 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b40929d1-47e9-45a2-bc85-2629f76226b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.181493 Apr 11 14:01:16.037329 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 345/693] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:15 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:16.066308 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-93511ccb-94e5-4477-a01e-39f7e0a8308c req-a37dd50c-59f2-465b-b3ce-730f46ce89b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2990320-e015-4b65-9175-4b875d4142fd", "name": "network-vif-plugged", "status": "completed", "tag": "26a6c2cb-0c2f-44e9-812a-19d9f51501fe"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:16.075960 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-93511ccb-94e5-4477-a01e-39f7e0a8308c req-a37dd50c-59f2-465b-b3ce-730f46ce89b0 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:16.076536 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-93511ccb-94e5-4477-a01e-39f7e0a8308c req-a37dd50c-59f2-465b-b3ce-730f46ce89b0 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:16.088485 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-93511ccb-94e5-4477-a01e-39f7e0a8308c req-a37dd50c-59f2-465b-b3ce-730f46ce89b0 service nova] Creating event network-vif-plugged:26a6c2cb-0c2f-44e9-812a-19d9f51501fe for instance c2990320-e015-4b65-9175-4b875d4142fd on hv-cinder-83078 Apr 11 14:01:16.093983 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-93511ccb-94e5-4477-a01e-39f7e0a8308c req-a37dd50c-59f2-465b-b3ce-730f46ce89b0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031311 Apr 11 14:01:16.094832 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 349/694] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:01:16.730903 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-67b96bc3-13da-4987-8d0a-597a453f7869 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:16.731838 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-67b96bc3-13da-4987-8d0a-597a453f7869 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:16.737818 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67b96bc3-13da-4987-8d0a-597a453f7869 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:16.738280 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67b96bc3-13da-4987-8d0a-597a453f7869 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:16.739063 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67b96bc3-13da-4987-8d0a-597a453f7869 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:16.739500 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67b96bc3-13da-4987-8d0a-597a453f7869 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:16.889024 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-67b96bc3-13da-4987-8d0a-597a453f7869 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:16.897938 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-67b96bc3-13da-4987-8d0a-597a453f7869 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1363 microversion: 2.1 time: 0.171362 Apr 11 14:01:16.898621 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 346/695] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:16 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:17.056624 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4d33eef3-b490-4baf-affc-eefc76711001 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:17.057312 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4d33eef3-b490-4baf-affc-eefc76711001 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:17.063589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d33eef3-b490-4baf-affc-eefc76711001 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:17.064083 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d33eef3-b490-4baf-affc-eefc76711001 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:17.065159 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d33eef3-b490-4baf-affc-eefc76711001 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:17.065604 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d33eef3-b490-4baf-affc-eefc76711001 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:17.309254 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4d33eef3-b490-4baf-affc-eefc76711001 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:17.317990 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4d33eef3-b490-4baf-affc-eefc76711001 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:17.319598 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4d33eef3-b490-4baf-affc-eefc76711001 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:17.320858 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4d33eef3-b490-4baf-affc-eefc76711001 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.269219 Apr 11 14:01:17.322155 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 350/696] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:17 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:17.915707 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-23a042be-51ab-4d29-aaee-281ea2221ea9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:17.916322 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-23a042be-51ab-4d29-aaee-281ea2221ea9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:17.922723 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23a042be-51ab-4d29-aaee-281ea2221ea9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:17.923165 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23a042be-51ab-4d29-aaee-281ea2221ea9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:17.923955 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23a042be-51ab-4d29-aaee-281ea2221ea9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:17.924385 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23a042be-51ab-4d29-aaee-281ea2221ea9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:18.053740 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-23a042be-51ab-4d29-aaee-281ea2221ea9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:18.061659 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-23a042be-51ab-4d29-aaee-281ea2221ea9 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1550 microversion: 2.1 time: 0.150431 Apr 11 14:01:18.062241 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 347/697] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:17 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:18.078327 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-157e52a3-896b-4f51-9328-57cfbc8bb045 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:18.078885 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-157e52a3-896b-4f51-9328-57cfbc8bb045 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:18.085016 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-157e52a3-896b-4f51-9328-57cfbc8bb045 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:18.085478 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-157e52a3-896b-4f51-9328-57cfbc8bb045 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:18.086254 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-157e52a3-896b-4f51-9328-57cfbc8bb045 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:18.087481 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-157e52a3-896b-4f51-9328-57cfbc8bb045 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:18.186839 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-157e52a3-896b-4f51-9328-57cfbc8bb045 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112301 Apr 11 14:01:18.187668 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 351/698] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Apr 11 14:01:18 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:01:18.340292 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4d0a8ca1-d319-43ac-bf55-3d4f0907e5af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:18.341170 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4d0a8ca1-d319-43ac-bf55-3d4f0907e5af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:18.347261 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4d0a8ca1-d319-43ac-bf55-3d4f0907e5af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:18.347871 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4d0a8ca1-d319-43ac-bf55-3d4f0907e5af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:18.348912 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4d0a8ca1-d319-43ac-bf55-3d4f0907e5af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:18.349481 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4d0a8ca1-d319-43ac-bf55-3d4f0907e5af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:18.579687 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4d0a8ca1-d319-43ac-bf55-3d4f0907e5af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:18.588304 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4d0a8ca1-d319-43ac-bf55-3d4f0907e5af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:18.589946 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4d0a8ca1-d319-43ac-bf55-3d4f0907e5af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:18.591249 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4d0a8ca1-d319-43ac-bf55-3d4f0907e5af tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.255788 Apr 11 14:01:18.592136 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 348/699] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:18 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:19.271791 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-1c77fa1c-5dad-47bd-86f5-fa68c4dfc743 req-ba583026-edf8-4cdd-a101-5b6760f6f6fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2990320-e015-4b65-9175-4b875d4142fd", "tag": "26a6c2cb-0c2f-44e9-812a-19d9f51501fe"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:19.281754 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-1c77fa1c-5dad-47bd-86f5-fa68c4dfc743 req-ba583026-edf8-4cdd-a101-5b6760f6f6fe service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:19.282356 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-1c77fa1c-5dad-47bd-86f5-fa68c4dfc743 req-ba583026-edf8-4cdd-a101-5b6760f6f6fe service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:19.295138 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-1c77fa1c-5dad-47bd-86f5-fa68c4dfc743 req-ba583026-edf8-4cdd-a101-5b6760f6f6fe service nova] Creating event network-changed:26a6c2cb-0c2f-44e9-812a-19d9f51501fe for instance c2990320-e015-4b65-9175-4b875d4142fd on hv-cinder-83078 Apr 11 14:01:19.300476 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-1c77fa1c-5dad-47bd-86f5-fa68c4dfc743 req-ba583026-edf8-4cdd-a101-5b6760f6f6fe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032927 Apr 11 14:01:19.301411 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 352/700] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:01:19.609701 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-01c2f090-5821-42de-aadc-b4a26cd5bb44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:19.610868 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-01c2f090-5821-42de-aadc-b4a26cd5bb44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:19.617612 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-01c2f090-5821-42de-aadc-b4a26cd5bb44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:19.618129 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-01c2f090-5821-42de-aadc-b4a26cd5bb44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:19.618914 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-01c2f090-5821-42de-aadc-b4a26cd5bb44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:19.619348 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-01c2f090-5821-42de-aadc-b4a26cd5bb44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:19.908626 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-01c2f090-5821-42de-aadc-b4a26cd5bb44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:19.918284 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-01c2f090-5821-42de-aadc-b4a26cd5bb44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:19.920120 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-01c2f090-5821-42de-aadc-b4a26cd5bb44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:19.921586 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-01c2f090-5821-42de-aadc-b4a26cd5bb44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.315742 Apr 11 14:01:19.922350 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 349/701] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:19 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:20.944488 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6691863f-7e6e-4452-839e-16085483cd7e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:20.945287 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6691863f-7e6e-4452-839e-16085483cd7e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:20.952971 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6691863f-7e6e-4452-839e-16085483cd7e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:20.953430 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6691863f-7e6e-4452-839e-16085483cd7e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:20.954429 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6691863f-7e6e-4452-839e-16085483cd7e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:20.955042 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6691863f-7e6e-4452-839e-16085483cd7e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:21.131604 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6691863f-7e6e-4452-839e-16085483cd7e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:21.141036 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6691863f-7e6e-4452-839e-16085483cd7e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:21.142550 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6691863f-7e6e-4452-839e-16085483cd7e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:21.143780 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6691863f-7e6e-4452-839e-16085483cd7e tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.204767 Apr 11 14:01:21.144337 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 353/702] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:20 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:22.162246 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-846fe63f-0dd9-4b96-abaa-2d4f5290a13f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:22.163580 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-846fe63f-0dd9-4b96-abaa-2d4f5290a13f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:22.171743 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-846fe63f-0dd9-4b96-abaa-2d4f5290a13f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:22.172642 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-846fe63f-0dd9-4b96-abaa-2d4f5290a13f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:22.173649 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-846fe63f-0dd9-4b96-abaa-2d4f5290a13f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:22.174438 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-846fe63f-0dd9-4b96-abaa-2d4f5290a13f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:22.649230 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-846fe63f-0dd9-4b96-abaa-2d4f5290a13f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:22.658035 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-846fe63f-0dd9-4b96-abaa-2d4f5290a13f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:22.659524 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-846fe63f-0dd9-4b96-abaa-2d4f5290a13f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:22.660938 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-846fe63f-0dd9-4b96-abaa-2d4f5290a13f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.502541 Apr 11 14:01:22.661508 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 350/703] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:22 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:23.679535 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f2623d2a-4d28-4e54-805d-b1bbf3e5fb02 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:23.681027 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f2623d2a-4d28-4e54-805d-b1bbf3e5fb02 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:23.690582 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f2623d2a-4d28-4e54-805d-b1bbf3e5fb02 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:23.691047 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f2623d2a-4d28-4e54-805d-b1bbf3e5fb02 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:23.691884 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f2623d2a-4d28-4e54-805d-b1bbf3e5fb02 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:23.692333 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f2623d2a-4d28-4e54-805d-b1bbf3e5fb02 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:23.880646 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f2623d2a-4d28-4e54-805d-b1bbf3e5fb02 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:23.893562 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f2623d2a-4d28-4e54-805d-b1bbf3e5fb02 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:23.895469 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f2623d2a-4d28-4e54-805d-b1bbf3e5fb02 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:23.897544 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f2623d2a-4d28-4e54-805d-b1bbf3e5fb02 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1744 microversion: 2.20 time: 0.221280 Apr 11 14:01:23.899305 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 354/704] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:23 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:24.917493 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-63382426-bf05-48b0-8fbb-18cd6d9e18ef tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:24.918856 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-63382426-bf05-48b0-8fbb-18cd6d9e18ef tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:24.925956 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63382426-bf05-48b0-8fbb-18cd6d9e18ef tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:24.926527 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63382426-bf05-48b0-8fbb-18cd6d9e18ef tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:24.927441 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63382426-bf05-48b0-8fbb-18cd6d9e18ef tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:24.927997 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63382426-bf05-48b0-8fbb-18cd6d9e18ef tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:25.080425 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-63382426-bf05-48b0-8fbb-18cd6d9e18ef tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:25.091504 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-63382426-bf05-48b0-8fbb-18cd6d9e18ef tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:25.093037 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-63382426-bf05-48b0-8fbb-18cd6d9e18ef tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:25.094270 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-63382426-bf05-48b0-8fbb-18cd6d9e18ef tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1744 microversion: 2.20 time: 0.180820 Apr 11 14:01:25.094788 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 351/705] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:24 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:26.112613 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-aa36bbb3-16a2-49a6-9e73-bbbbaa055862 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:26.113230 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-aa36bbb3-16a2-49a6-9e73-bbbbaa055862 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:26.122882 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aa36bbb3-16a2-49a6-9e73-bbbbaa055862 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:26.125780 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aa36bbb3-16a2-49a6-9e73-bbbbaa055862 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:26.132146 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aa36bbb3-16a2-49a6-9e73-bbbbaa055862 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:26.133853 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aa36bbb3-16a2-49a6-9e73-bbbbaa055862 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:26.385004 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-aa36bbb3-16a2-49a6-9e73-bbbbaa055862 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:26.401063 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-aa36bbb3-16a2-49a6-9e73-bbbbaa055862 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:26.403744 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-aa36bbb3-16a2-49a6-9e73-bbbbaa055862 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:26.404960 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-aa36bbb3-16a2-49a6-9e73-bbbbaa055862 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1739 microversion: 2.20 time: 0.296389 Apr 11 14:01:26.409414 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 355/706] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:26 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:27.425239 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1ec3607e-ef79-4716-9b6f-65b3cfe7dbac tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:27.426446 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1ec3607e-ef79-4716-9b6f-65b3cfe7dbac tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:27.434725 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ec3607e-ef79-4716-9b6f-65b3cfe7dbac tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:27.435186 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ec3607e-ef79-4716-9b6f-65b3cfe7dbac tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:27.456300 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ec3607e-ef79-4716-9b6f-65b3cfe7dbac tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:27.456803 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ec3607e-ef79-4716-9b6f-65b3cfe7dbac tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:27.798207 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1ec3607e-ef79-4716-9b6f-65b3cfe7dbac tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:27.811256 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1ec3607e-ef79-4716-9b6f-65b3cfe7dbac tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:27.814061 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1ec3607e-ef79-4716-9b6f-65b3cfe7dbac tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:27.816784 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1ec3607e-ef79-4716-9b6f-65b3cfe7dbac tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1739 microversion: 2.20 time: 0.397354 Apr 11 14:01:27.840731 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 352/707] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:27 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1739 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:28.193601 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0ed4a5e6-c0fc-4209-b012-3950993c106a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:28.194871 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0ed4a5e6-c0fc-4209-b012-3950993c106a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:28.205381 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ed4a5e6-c0fc-4209-b012-3950993c106a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:28.208242 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ed4a5e6-c0fc-4209-b012-3950993c106a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:28.211223 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ed4a5e6-c0fc-4209-b012-3950993c106a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:28.216539 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ed4a5e6-c0fc-4209-b012-3950993c106a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:28.287582 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-0ed4a5e6-c0fc-4209-b012-3950993c106a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lazy-loading 'flavor' on Instance uuid e2a988bf-9fbe-4371-a34f-2437494ec1ee {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:01:28.463854 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0ed4a5e6-c0fc-4209-b012-3950993c106a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "POST /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee/action" status: 202 len: 0 microversion: 2.1 time: 0.274919 Apr 11 14:01:28.466773 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 356/708] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 14:01:28 2022] POST /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:01:28.475721 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5797861c-d4f9-4e09-8781-a72a62b44277 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:28.477493 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5797861c-d4f9-4e09-8781-a72a62b44277 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:28.493342 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5797861c-d4f9-4e09-8781-a72a62b44277 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:28.495349 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5797861c-d4f9-4e09-8781-a72a62b44277 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:28.497647 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5797861c-d4f9-4e09-8781-a72a62b44277 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:28.499731 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5797861c-d4f9-4e09-8781-a72a62b44277 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:28.844616 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-81f81dd6-71a9-45dc-890d-887a2bddf741 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:28.845968 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-81f81dd6-71a9-45dc-890d-887a2bddf741 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:28.863313 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-81f81dd6-71a9-45dc-890d-887a2bddf741 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:28.868753 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-81f81dd6-71a9-45dc-890d-887a2bddf741 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:28.870049 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-81f81dd6-71a9-45dc-890d-887a2bddf741 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:28.871951 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-81f81dd6-71a9-45dc-890d-887a2bddf741 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:29.093867 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5797861c-d4f9-4e09-8781-a72a62b44277 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:29.106726 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5797861c-d4f9-4e09-8781-a72a62b44277 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.636037 Apr 11 14:01:29.124537 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 353/709] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:28 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:29.145793 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-26e0a1e0-24cb-487e-8380-1cb6ebe0217d req-93aa7635-333e-46f2-a588-c07fc56423a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf497683-01c3-4106-adb0-36d23d564607", "name": "network-vif-plugged", "status": "completed", "tag": "9c6a342b-a134-4ab5-996e-3eab3c406817"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:29.172445 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-26e0a1e0-24cb-487e-8380-1cb6ebe0217d req-93aa7635-333e-46f2-a588-c07fc56423a3 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:29.173388 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-26e0a1e0-24cb-487e-8380-1cb6ebe0217d req-93aa7635-333e-46f2-a588-c07fc56423a3 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:29.196322 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-81f81dd6-71a9-45dc-890d-887a2bddf741 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:29.207414 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-81f81dd6-71a9-45dc-890d-887a2bddf741 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:29.209324 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-81f81dd6-71a9-45dc-890d-887a2bddf741 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:29.211100 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-26e0a1e0-24cb-487e-8380-1cb6ebe0217d req-93aa7635-333e-46f2-a588-c07fc56423a3 service nova] Creating event network-vif-plugged:9c6a342b-a134-4ab5-996e-3eab3c406817 for instance cf497683-01c3-4106-adb0-36d23d564607 on hv-cinder-83078 Apr 11 14:01:29.220010 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-81f81dd6-71a9-45dc-890d-887a2bddf741 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1739 microversion: 2.20 time: 0.385768 Apr 11 14:01:29.221271 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-26e0a1e0-24cb-487e-8380-1cb6ebe0217d req-93aa7635-333e-46f2-a588-c07fc56423a3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090178 Apr 11 14:01:29.221907 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 354/710] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:01:29.224852 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 357/711] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:28 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1739 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:01:30.134985 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-00e31b1a-3345-4a46-996b-0c35b04b9f84 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:30.135725 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-00e31b1a-3345-4a46-996b-0c35b04b9f84 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:30.142440 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00e31b1a-3345-4a46-996b-0c35b04b9f84 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:30.143234 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00e31b1a-3345-4a46-996b-0c35b04b9f84 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:30.144581 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00e31b1a-3345-4a46-996b-0c35b04b9f84 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:30.145344 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00e31b1a-3345-4a46-996b-0c35b04b9f84 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:30.242379 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0ae430fd-8e89-4d29-a614-e262f5e00e33 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:30.243403 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0ae430fd-8e89-4d29-a614-e262f5e00e33 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:30.251765 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ae430fd-8e89-4d29-a614-e262f5e00e33 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:30.252323 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ae430fd-8e89-4d29-a614-e262f5e00e33 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:30.253539 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ae430fd-8e89-4d29-a614-e262f5e00e33 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:30.254447 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ae430fd-8e89-4d29-a614-e262f5e00e33 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:30.456762 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0ae430fd-8e89-4d29-a614-e262f5e00e33 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:30.471018 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0ae430fd-8e89-4d29-a614-e262f5e00e33 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:30.473270 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0ae430fd-8e89-4d29-a614-e262f5e00e33 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:30.474823 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0ae430fd-8e89-4d29-a614-e262f5e00e33 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1739 microversion: 2.20 time: 0.237344 Apr 11 14:01:30.492851 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 358/712] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:30 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:01:30.771472 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-00e31b1a-3345-4a46-996b-0c35b04b9f84 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:30.780568 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-00e31b1a-3345-4a46-996b-0c35b04b9f84 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.652676 Apr 11 14:01:30.799483 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 355/713] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:30 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:31.294813 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5071db1b-59d8-46c5-a041-6dbde890a1df tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Action: 'create', calling method: .version_select at 0x7f73069efd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1198794692"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:31.318382 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-5071db1b-59d8-46c5-a041-6dbde890a1df tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Getting quotas for project 40c040f0c3e74276bcab8dbc8e439de5. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:01:31.325797 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-5071db1b-59d8-46c5-a041-6dbde890a1df tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Getting quotas for user 64643f7804ba42f5886f949134dd4d06 and project 40c040f0c3e74276bcab8dbc8e439de5. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:01:31.494775 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a39b590c-a1a3-4233-89d3-49cdfb4c4c48 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:31.496137 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a39b590c-a1a3-4233-89d3-49cdfb4c4c48 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:31.503710 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a39b590c-a1a3-4233-89d3-49cdfb4c4c48 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:31.504469 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a39b590c-a1a3-4233-89d3-49cdfb4c4c48 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:31.505670 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a39b590c-a1a3-4233-89d3-49cdfb4c4c48 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:31.510443 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a39b590c-a1a3-4233-89d3-49cdfb4c4c48 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:31.660948 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-5071db1b-59d8-46c5-a041-6dbde890a1df tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Getting quotas for project 40c040f0c3e74276bcab8dbc8e439de5. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:01:31.666028 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-5071db1b-59d8-46c5-a041-6dbde890a1df tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Getting quotas for user 64643f7804ba42f5886f949134dd4d06 and project 40c040f0c3e74276bcab8dbc8e439de5. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:01:31.688353 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5071db1b-59d8-46c5-a041-6dbde890a1df tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.633770 Apr 11 14:01:31.689511 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 359/714] 10.222.0.67 () {60 vars in 1157 bytes} [Mon Apr 11 14:01:31 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:31.720778 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a39b590c-a1a3-4233-89d3-49cdfb4c4c48 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:31.736353 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a39b590c-a1a3-4233-89d3-49cdfb4c4c48 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:31.738735 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a39b590c-a1a3-4233-89d3-49cdfb4c4c48 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:31.740191 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a39b590c-a1a3-4233-89d3-49cdfb4c4c48 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1739 microversion: 2.20 time: 0.249869 Apr 11 14:01:31.740763 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 356/715] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:31 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:01:31.805361 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6e9170fa-f185-4d67-aaac-b02f5e4410d0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:31.806103 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6e9170fa-f185-4d67-aaac-b02f5e4410d0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:31.813279 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e9170fa-f185-4d67-aaac-b02f5e4410d0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:31.813868 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e9170fa-f185-4d67-aaac-b02f5e4410d0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:31.814736 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e9170fa-f185-4d67-aaac-b02f5e4410d0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:31.815238 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e9170fa-f185-4d67-aaac-b02f5e4410d0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:32.033855 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6e9170fa-f185-4d67-aaac-b02f5e4410d0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:32.044768 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6e9170fa-f185-4d67-aaac-b02f5e4410d0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.243647 Apr 11 14:01:32.045807 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 360/716] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:31 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:32.759804 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-da8be039-dd92-44ad-bc88-f399c46d5be0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:32.760429 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-da8be039-dd92-44ad-bc88-f399c46d5be0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:32.771202 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da8be039-dd92-44ad-bc88-f399c46d5be0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:32.771961 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da8be039-dd92-44ad-bc88-f399c46d5be0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:32.773103 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da8be039-dd92-44ad-bc88-f399c46d5be0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:32.773828 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da8be039-dd92-44ad-bc88-f399c46d5be0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:33.007687 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-da8be039-dd92-44ad-bc88-f399c46d5be0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:33.019498 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-da8be039-dd92-44ad-bc88-f399c46d5be0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:33.024557 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-da8be039-dd92-44ad-bc88-f399c46d5be0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:33.025752 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-da8be039-dd92-44ad-bc88-f399c46d5be0 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1739 microversion: 2.20 time: 0.271393 Apr 11 14:01:33.026324 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 357/717] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:32 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:33.061798 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b225cbc2-99af-4e8a-b39e-3f2d171070f6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:33.062430 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b225cbc2-99af-4e8a-b39e-3f2d171070f6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:33.070742 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b225cbc2-99af-4e8a-b39e-3f2d171070f6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:33.071252 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b225cbc2-99af-4e8a-b39e-3f2d171070f6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:33.077556 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b225cbc2-99af-4e8a-b39e-3f2d171070f6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:33.078036 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b225cbc2-99af-4e8a-b39e-3f2d171070f6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:33.281160 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b225cbc2-99af-4e8a-b39e-3f2d171070f6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:33.296377 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b225cbc2-99af-4e8a-b39e-3f2d171070f6 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.237949 Apr 11 14:01:33.297758 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 361/718] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:33 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:34.053456 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b5564376-c601-4924-84df-ef00027a2c1b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:34.055681 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b5564376-c601-4924-84df-ef00027a2c1b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:34.064990 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b5564376-c601-4924-84df-ef00027a2c1b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:34.065770 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b5564376-c601-4924-84df-ef00027a2c1b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:34.066849 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b5564376-c601-4924-84df-ef00027a2c1b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:34.068414 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b5564376-c601-4924-84df-ef00027a2c1b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:34.316237 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ec1cbda4-5748-4bc2-978a-1579c5f12042 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:34.317072 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ec1cbda4-5748-4bc2-978a-1579c5f12042 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:34.362774 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ec1cbda4-5748-4bc2-978a-1579c5f12042 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:34.363815 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ec1cbda4-5748-4bc2-978a-1579c5f12042 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:34.367518 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ec1cbda4-5748-4bc2-978a-1579c5f12042 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:34.369180 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ec1cbda4-5748-4bc2-978a-1579c5f12042 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:34.386745 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b5564376-c601-4924-84df-ef00027a2c1b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:34.407733 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b5564376-c601-4924-84df-ef00027a2c1b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:34.422379 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b5564376-c601-4924-84df-ef00027a2c1b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:34.424631 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b5564376-c601-4924-84df-ef00027a2c1b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1739 microversion: 2.20 time: 0.375208 Apr 11 14:01:34.437691 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 358/719] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:34 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1739 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:34.590834 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ec1cbda4-5748-4bc2-978a-1579c5f12042 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:34.599762 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ec1cbda4-5748-4bc2-978a-1579c5f12042 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.288243 Apr 11 14:01:34.603446 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 362/720] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:34 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:35.443760 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7f566f91-8976-46b2-9c4d-8e00f6d0bfc8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:35.444921 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7f566f91-8976-46b2-9c4d-8e00f6d0bfc8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:35.454875 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7f566f91-8976-46b2-9c4d-8e00f6d0bfc8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:35.455179 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7f566f91-8976-46b2-9c4d-8e00f6d0bfc8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:35.455989 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7f566f91-8976-46b2-9c4d-8e00f6d0bfc8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:35.456606 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7f566f91-8976-46b2-9c4d-8e00f6d0bfc8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:35.629158 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7f566f91-8976-46b2-9c4d-8e00f6d0bfc8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:35.643647 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7f566f91-8976-46b2-9c4d-8e00f6d0bfc8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:35.645639 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7f566f91-8976-46b2-9c4d-8e00f6d0bfc8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:35.647294 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7f566f91-8976-46b2-9c4d-8e00f6d0bfc8 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1739 microversion: 2.20 time: 0.207454 Apr 11 14:01:35.658151 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b6f349de-bbe3-4aba-ba4e-752873cf5c4c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:35.659512 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b6f349de-bbe3-4aba-ba4e-752873cf5c4c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:35.660106 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 359/721] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:35 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:35.667700 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b6f349de-bbe3-4aba-ba4e-752873cf5c4c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:35.668557 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b6f349de-bbe3-4aba-ba4e-752873cf5c4c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:35.670014 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b6f349de-bbe3-4aba-ba4e-752873cf5c4c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:35.670667 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b6f349de-bbe3-4aba-ba4e-752873cf5c4c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:35.863614 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b6f349de-bbe3-4aba-ba4e-752873cf5c4c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:35.871246 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b6f349de-bbe3-4aba-ba4e-752873cf5c4c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.243332 Apr 11 14:01:35.880870 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 363/722] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:35 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:36.667465 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ac1ee51c-2b15-47db-aac3-29f176f77c44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:36.668108 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ac1ee51c-2b15-47db-aac3-29f176f77c44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:36.676312 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac1ee51c-2b15-47db-aac3-29f176f77c44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:36.677450 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac1ee51c-2b15-47db-aac3-29f176f77c44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:36.678407 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac1ee51c-2b15-47db-aac3-29f176f77c44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:36.679380 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac1ee51c-2b15-47db-aac3-29f176f77c44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:36.848665 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ac1ee51c-2b15-47db-aac3-29f176f77c44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:36.857602 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ac1ee51c-2b15-47db-aac3-29f176f77c44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:36.859079 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ac1ee51c-2b15-47db-aac3-29f176f77c44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:36.860257 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ac1ee51c-2b15-47db-aac3-29f176f77c44 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1739 microversion: 2.20 time: 0.196999 Apr 11 14:01:36.861504 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 360/723] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:36 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:36.887944 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a366b63b-9bde-4119-9f53-ee2c80d351d8 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:36.888670 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a366b63b-9bde-4119-9f53-ee2c80d351d8 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:36.895777 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a366b63b-9bde-4119-9f53-ee2c80d351d8 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:36.896520 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a366b63b-9bde-4119-9f53-ee2c80d351d8 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:36.898152 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a366b63b-9bde-4119-9f53-ee2c80d351d8 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:36.898804 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a366b63b-9bde-4119-9f53-ee2c80d351d8 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:37.047681 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a366b63b-9bde-4119-9f53-ee2c80d351d8 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:37.056595 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a366b63b-9bde-4119-9f53-ee2c80d351d8 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.172490 Apr 11 14:01:37.058942 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 364/724] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:36 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:37.880499 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1038781a-e5bd-4fd3-aa42-b53b71804961 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:37.881110 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1038781a-e5bd-4fd3-aa42-b53b71804961 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:37.888259 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1038781a-e5bd-4fd3-aa42-b53b71804961 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:37.888983 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1038781a-e5bd-4fd3-aa42-b53b71804961 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:37.890012 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1038781a-e5bd-4fd3-aa42-b53b71804961 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:37.890520 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1038781a-e5bd-4fd3-aa42-b53b71804961 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:38.039000 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1038781a-e5bd-4fd3-aa42-b53b71804961 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:38.047837 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1038781a-e5bd-4fd3-aa42-b53b71804961 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:38.049323 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1038781a-e5bd-4fd3-aa42-b53b71804961 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:38.050490 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1038781a-e5bd-4fd3-aa42-b53b71804961 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1739 microversion: 2.20 time: 0.175513 Apr 11 14:01:38.051041 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 361/725] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:37 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:38.074537 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cb61c0b3-8746-4e9d-936d-065b8957cd54 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:38.075065 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cb61c0b3-8746-4e9d-936d-065b8957cd54 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:38.082854 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb61c0b3-8746-4e9d-936d-065b8957cd54 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:38.083321 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb61c0b3-8746-4e9d-936d-065b8957cd54 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:38.084137 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb61c0b3-8746-4e9d-936d-065b8957cd54 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:38.084584 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb61c0b3-8746-4e9d-936d-065b8957cd54 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:38.242020 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cb61c0b3-8746-4e9d-936d-065b8957cd54 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:38.250426 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cb61c0b3-8746-4e9d-936d-065b8957cd54 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.179793 Apr 11 14:01:38.251018 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 365/726] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:38 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:39.072085 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1d667701-16f5-48a8-844a-c89217614737 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:39.072760 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1d667701-16f5-48a8-844a-c89217614737 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:39.079567 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1d667701-16f5-48a8-844a-c89217614737 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:39.080141 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1d667701-16f5-48a8-844a-c89217614737 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:39.080988 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1d667701-16f5-48a8-844a-c89217614737 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:39.081485 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1d667701-16f5-48a8-844a-c89217614737 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:39.236261 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1d667701-16f5-48a8-844a-c89217614737 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:39.242622 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1d667701-16f5-48a8-844a-c89217614737 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:39.244126 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1d667701-16f5-48a8-844a-c89217614737 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:39.245279 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1d667701-16f5-48a8-844a-c89217614737 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1739 microversion: 2.20 time: 0.177735 Apr 11 14:01:39.245851 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 362/727] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:39 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:39.267592 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-20e26137-a01a-4eb1-a1f7-e80f01f5845a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:39.268332 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-20e26137-a01a-4eb1-a1f7-e80f01f5845a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:39.275295 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-20e26137-a01a-4eb1-a1f7-e80f01f5845a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:39.275922 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-20e26137-a01a-4eb1-a1f7-e80f01f5845a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:39.277044 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-20e26137-a01a-4eb1-a1f7-e80f01f5845a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:39.277500 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-20e26137-a01a-4eb1-a1f7-e80f01f5845a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:39.414292 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-20e26137-a01a-4eb1-a1f7-e80f01f5845a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:39.421674 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-20e26137-a01a-4eb1-a1f7-e80f01f5845a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.157918 Apr 11 14:01:39.422261 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 366/728] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:39 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:40.264211 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b94e4ba4-35a9-47dc-9313-ce50ac78e857 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:40.264833 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b94e4ba4-35a9-47dc-9313-ce50ac78e857 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:40.270916 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b94e4ba4-35a9-47dc-9313-ce50ac78e857 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:40.271370 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b94e4ba4-35a9-47dc-9313-ce50ac78e857 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:40.273079 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b94e4ba4-35a9-47dc-9313-ce50ac78e857 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:40.273529 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b94e4ba4-35a9-47dc-9313-ce50ac78e857 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:40.440897 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-16229e7c-44bb-4704-bdf6-f090ea311918 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:40.441701 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-16229e7c-44bb-4704-bdf6-f090ea311918 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:40.448035 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16229e7c-44bb-4704-bdf6-f090ea311918 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:40.448496 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16229e7c-44bb-4704-bdf6-f090ea311918 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:40.449284 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16229e7c-44bb-4704-bdf6-f090ea311918 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:40.449723 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16229e7c-44bb-4704-bdf6-f090ea311918 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:40.588312 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-16229e7c-44bb-4704-bdf6-f090ea311918 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:40.596685 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-16229e7c-44bb-4704-bdf6-f090ea311918 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.160987 Apr 11 14:01:40.597366 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 367/729] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:40 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:40.724119 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b94e4ba4-35a9-47dc-9313-ce50ac78e857 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:40.732483 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b94e4ba4-35a9-47dc-9313-ce50ac78e857 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:40.733984 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b94e4ba4-35a9-47dc-9313-ce50ac78e857 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:40.735146 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b94e4ba4-35a9-47dc-9313-ce50ac78e857 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1721 microversion: 2.20 time: 0.475453 Apr 11 14:01:40.735740 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 363/730] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:40 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1721 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:41.615639 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d55593b4-a3dc-472d-bf75-2ff9b453026d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:41.617130 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d55593b4-a3dc-472d-bf75-2ff9b453026d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:41.623879 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d55593b4-a3dc-472d-bf75-2ff9b453026d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:41.624330 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d55593b4-a3dc-472d-bf75-2ff9b453026d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:41.625142 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d55593b4-a3dc-472d-bf75-2ff9b453026d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:41.625609 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d55593b4-a3dc-472d-bf75-2ff9b453026d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:41.754222 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-07dfc7f2-db6b-467e-a11c-f595cd28fb60 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:41.754890 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-07dfc7f2-db6b-467e-a11c-f595cd28fb60 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:41.762405 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-07dfc7f2-db6b-467e-a11c-f595cd28fb60 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:41.762981 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-07dfc7f2-db6b-467e-a11c-f595cd28fb60 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:41.764283 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-07dfc7f2-db6b-467e-a11c-f595cd28fb60 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:41.764986 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-07dfc7f2-db6b-467e-a11c-f595cd28fb60 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:41.768242 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d55593b4-a3dc-472d-bf75-2ff9b453026d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:41.780338 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d55593b4-a3dc-472d-bf75-2ff9b453026d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.168414 Apr 11 14:01:41.781300 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 368/731] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:41 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:41.910659 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-07dfc7f2-db6b-467e-a11c-f595cd28fb60 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:41.918541 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-07dfc7f2-db6b-467e-a11c-f595cd28fb60 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:41.920077 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-07dfc7f2-db6b-467e-a11c-f595cd28fb60 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:41.921238 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-07dfc7f2-db6b-467e-a11c-f595cd28fb60 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1721 microversion: 2.20 time: 0.170880 Apr 11 14:01:41.921808 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 364/732] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:41 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:01:42.806335 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3ce03ff7-ca8f-4ef5-8b86-8ca814877351 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:42.807643 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3ce03ff7-ca8f-4ef5-8b86-8ca814877351 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:42.815234 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3ce03ff7-ca8f-4ef5-8b86-8ca814877351 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:42.815825 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3ce03ff7-ca8f-4ef5-8b86-8ca814877351 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:42.816389 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3ce03ff7-ca8f-4ef5-8b86-8ca814877351 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:42.816962 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3ce03ff7-ca8f-4ef5-8b86-8ca814877351 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:42.940069 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c2ffd8b8-7bcf-4f8a-bce3-4aa208af35de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:42.940687 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c2ffd8b8-7bcf-4f8a-bce3-4aa208af35de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:42.947249 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c2ffd8b8-7bcf-4f8a-bce3-4aa208af35de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:42.947707 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c2ffd8b8-7bcf-4f8a-bce3-4aa208af35de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:42.948492 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c2ffd8b8-7bcf-4f8a-bce3-4aa208af35de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:42.949136 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c2ffd8b8-7bcf-4f8a-bce3-4aa208af35de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:42.953487 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3ce03ff7-ca8f-4ef5-8b86-8ca814877351 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:42.961808 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3ce03ff7-ca8f-4ef5-8b86-8ca814877351 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.159721 Apr 11 14:01:42.962399 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 369/733] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:42 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:43.080480 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c2ffd8b8-7bcf-4f8a-bce3-4aa208af35de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:43.088796 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c2ffd8b8-7bcf-4f8a-bce3-4aa208af35de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:43.090295 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c2ffd8b8-7bcf-4f8a-bce3-4aa208af35de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:43.091455 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c2ffd8b8-7bcf-4f8a-bce3-4aa208af35de tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1664 microversion: 2.20 time: 0.155445 Apr 11 14:01:43.092057 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 365/734] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:42 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:01:43.108990 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-42f0490b-8210-4b74-8871-cfb73fd395b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab443300-dab4-4a42-af7b-21a2f3bd3ba2"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:43.110056 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-42f0490b-8210-4b74-8871-cfb73fd395b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:43.116315 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-42f0490b-8210-4b74-8871-cfb73fd395b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:43.116824 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-42f0490b-8210-4b74-8871-cfb73fd395b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:43.117603 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-42f0490b-8210-4b74-8871-cfb73fd395b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:43.118049 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-42f0490b-8210-4b74-8871-cfb73fd395b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:43.378463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-42f0490b-8210-4b74-8871-cfb73fd395b5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "POST /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.273386 Apr 11 14:01:43.379086 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 370/735] 10.222.0.67 () {62 vars in 1363 bytes} [Mon Apr 11 14:01:43 2022] POST /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/os-volume_attachments => generated 188 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 14:01:43.495880 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b8acd599-4a78-44be-a4f2-73e08d9d9187 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:43.496375 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b8acd599-4a78-44be-a4f2-73e08d9d9187 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:43.502117 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b8acd599-4a78-44be-a4f2-73e08d9d9187 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:43.502559 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b8acd599-4a78-44be-a4f2-73e08d9d9187 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:43.503317 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b8acd599-4a78-44be-a4f2-73e08d9d9187 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:43.503774 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b8acd599-4a78-44be-a4f2-73e08d9d9187 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:43.750908 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b8acd599-4a78-44be-a4f2-73e08d9d9187 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/os-volume_attachments/ab443300-dab4-4a42-af7b-21a2f3bd3ba2" status: 202 len: 0 microversion: 2.20 time: 0.258832 Apr 11 14:01:43.751663 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 366/736] 10.222.0.67 () {60 vars in 1456 bytes} [Mon Apr 11 14:01:43 2022] DELETE /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/os-volume_attachments/ab443300-dab4-4a42-af7b-21a2f3bd3ba2 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:01:43.817965 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-369713b7-5e01-4e12-a38e-66e33be11ecd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:43.819046 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-369713b7-5e01-4e12-a38e-66e33be11ecd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:43.825346 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-369713b7-5e01-4e12-a38e-66e33be11ecd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:43.825810 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-369713b7-5e01-4e12-a38e-66e33be11ecd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:43.826593 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-369713b7-5e01-4e12-a38e-66e33be11ecd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:43.827037 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-369713b7-5e01-4e12-a38e-66e33be11ecd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:43.913004 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-369713b7-5e01-4e12-a38e-66e33be11ecd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "POST /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/action" status: 202 len: 0 microversion: 2.20 time: 0.098511 Apr 11 14:01:43.916969 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 371/737] 10.222.0.67 () {62 vars in 1318 bytes} [Mon Apr 11 14:01:43 2022] POST /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:01:43.922293 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7e9312f5-bd1d-47fe-897c-2572257bcc85 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:43.923402 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7e9312f5-bd1d-47fe-897c-2572257bcc85 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:43.930746 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7e9312f5-bd1d-47fe-897c-2572257bcc85 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:43.931424 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7e9312f5-bd1d-47fe-897c-2572257bcc85 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:43.932529 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7e9312f5-bd1d-47fe-897c-2572257bcc85 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:43.933443 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7e9312f5-bd1d-47fe-897c-2572257bcc85 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:43.978974 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f66cac00-9eef-4190-83d8-373413d2298b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:43.980105 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f66cac00-9eef-4190-83d8-373413d2298b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:43.986536 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f66cac00-9eef-4190-83d8-373413d2298b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:43.987167 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f66cac00-9eef-4190-83d8-373413d2298b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:43.988440 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f66cac00-9eef-4190-83d8-373413d2298b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:43.989046 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f66cac00-9eef-4190-83d8-373413d2298b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:44.166075 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7e9312f5-bd1d-47fe-897c-2572257bcc85 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:44.174558 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7e9312f5-bd1d-47fe-897c-2572257bcc85 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:44.176408 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7e9312f5-bd1d-47fe-897c-2572257bcc85 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:44.178498 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7e9312f5-bd1d-47fe-897c-2572257bcc85 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1672 microversion: 2.20 time: 0.259859 Apr 11 14:01:44.180016 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 367/738] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:43 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1672 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:01:44.185035 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-75e1efe7-f2bc-4c16-b008-11acf36006e6 req-86b8f027-97c1-4d9a-9ad9-6ad4fee2fc29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf497683-01c3-4106-adb0-36d23d564607", "name": "network-vif-unplugged", "status": "completed", "tag": "9c6a342b-a134-4ab5-996e-3eab3c406817"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:44.194983 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-75e1efe7-f2bc-4c16-b008-11acf36006e6 req-86b8f027-97c1-4d9a-9ad9-6ad4fee2fc29 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:44.195749 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-75e1efe7-f2bc-4c16-b008-11acf36006e6 req-86b8f027-97c1-4d9a-9ad9-6ad4fee2fc29 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:44.202751 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f66cac00-9eef-4190-83d8-373413d2298b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:44.210724 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f66cac00-9eef-4190-83d8-373413d2298b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.235899 Apr 11 14:01:44.211892 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 372/739] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:43 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:44.213680 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.compute.server_external_events [req-75e1efe7-f2bc-4c16-b008-11acf36006e6 req-86b8f027-97c1-4d9a-9ad9-6ad4fee2fc29 service nova] Unable to find a host for instance cf497683-01c3-4106-adb0-36d23d564607. Dropping event network-vif-unplugged {{(pid=116942) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 11 14:01:44.214644 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-75e1efe7-f2bc-4c16-b008-11acf36006e6 req-86b8f027-97c1-4d9a-9ad9-6ad4fee2fc29 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033553 Apr 11 14:01:44.215612 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 368/740] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 11 14:01:45.202298 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f1d2c861-5264-455c-a16d-c8bb98536252 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:45.202736 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f1d2c861-5264-455c-a16d-c8bb98536252 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:45.209054 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1d2c861-5264-455c-a16d-c8bb98536252 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:45.209601 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1d2c861-5264-455c-a16d-c8bb98536252 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:45.210386 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1d2c861-5264-455c-a16d-c8bb98536252 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:45.210823 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1d2c861-5264-455c-a16d-c8bb98536252 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:45.228931 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-14a1f930-3638-466e-a92d-836ba099b25d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:45.229689 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-14a1f930-3638-466e-a92d-836ba099b25d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:45.235958 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-14a1f930-3638-466e-a92d-836ba099b25d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:45.236491 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-14a1f930-3638-466e-a92d-836ba099b25d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:45.237349 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-14a1f930-3638-466e-a92d-836ba099b25d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:45.237854 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-14a1f930-3638-466e-a92d-836ba099b25d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:45.337898 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f1d2c861-5264-455c-a16d-c8bb98536252 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:45.345859 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f1d2c861-5264-455c-a16d-c8bb98536252 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:45.347470 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f1d2c861-5264-455c-a16d-c8bb98536252 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:45.348674 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f1d2c861-5264-455c-a16d-c8bb98536252 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1672 microversion: 2.20 time: 0.150439 Apr 11 14:01:45.349254 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 373/741] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:45 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:45.372460 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-14a1f930-3638-466e-a92d-836ba099b25d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:45.379771 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-14a1f930-3638-466e-a92d-836ba099b25d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.155440 Apr 11 14:01:45.380362 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 369/742] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:45 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:46.367112 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-67282d90-cb73-41a2-80bd-7f382ef77dc5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:46.367775 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-67282d90-cb73-41a2-80bd-7f382ef77dc5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:46.374284 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-67282d90-cb73-41a2-80bd-7f382ef77dc5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:46.374746 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-67282d90-cb73-41a2-80bd-7f382ef77dc5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:46.375529 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-67282d90-cb73-41a2-80bd-7f382ef77dc5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:46.376006 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-67282d90-cb73-41a2-80bd-7f382ef77dc5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:46.397662 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4659bf6d-f342-4159-b631-f965f08b13e4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:46.398517 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4659bf6d-f342-4159-b631-f965f08b13e4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:46.405259 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4659bf6d-f342-4159-b631-f965f08b13e4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:46.405780 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4659bf6d-f342-4159-b631-f965f08b13e4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:46.406619 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4659bf6d-f342-4159-b631-f965f08b13e4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:46.407139 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4659bf6d-f342-4159-b631-f965f08b13e4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:46.541169 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-67282d90-cb73-41a2-80bd-7f382ef77dc5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:46.565538 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-67282d90-cb73-41a2-80bd-7f382ef77dc5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:46.567283 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-67282d90-cb73-41a2-80bd-7f382ef77dc5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:46.568886 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-67282d90-cb73-41a2-80bd-7f382ef77dc5 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.205861 Apr 11 14:01:46.580429 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 374/743] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:46 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:46.631123 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4659bf6d-f342-4159-b631-f965f08b13e4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:46.640276 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4659bf6d-f342-4159-b631-f965f08b13e4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.246805 Apr 11 14:01:46.641098 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 370/744] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:46 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:47.588931 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-dfd68e39-97a8-46fc-8f09-94f18e824062 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:47.589559 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-dfd68e39-97a8-46fc-8f09-94f18e824062 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:47.596455 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dfd68e39-97a8-46fc-8f09-94f18e824062 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:47.597477 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dfd68e39-97a8-46fc-8f09-94f18e824062 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:47.598580 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dfd68e39-97a8-46fc-8f09-94f18e824062 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:47.599316 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dfd68e39-97a8-46fc-8f09-94f18e824062 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:47.657472 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-be2810ce-8c8e-4cc4-983a-7e1c1e46196c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:47.658246 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-be2810ce-8c8e-4cc4-983a-7e1c1e46196c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:47.667266 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be2810ce-8c8e-4cc4-983a-7e1c1e46196c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:47.672643 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be2810ce-8c8e-4cc4-983a-7e1c1e46196c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:47.673782 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be2810ce-8c8e-4cc4-983a-7e1c1e46196c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:47.676632 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be2810ce-8c8e-4cc4-983a-7e1c1e46196c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:47.844802 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-dfd68e39-97a8-46fc-8f09-94f18e824062 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:47.853651 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-dfd68e39-97a8-46fc-8f09-94f18e824062 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:47.855567 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-dfd68e39-97a8-46fc-8f09-94f18e824062 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:47.856917 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-dfd68e39-97a8-46fc-8f09-94f18e824062 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.272002 Apr 11 14:01:47.858018 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 375/745] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:47 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:47.885543 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-be2810ce-8c8e-4cc4-983a-7e1c1e46196c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:47.893719 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-be2810ce-8c8e-4cc4-983a-7e1c1e46196c tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1509 microversion: 2.1 time: 0.240157 Apr 11 14:01:47.904401 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 371/746] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:47 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:47.911669 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-05610f83-a4d1-4b75-a56a-60175c66775f tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:47.913119 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-05610f83-a4d1-4b75-a56a-60175c66775f tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:47.919298 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-05610f83-a4d1-4b75-a56a-60175c66775f tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:47.920414 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-05610f83-a4d1-4b75-a56a-60175c66775f tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:47.921232 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-05610f83-a4d1-4b75-a56a-60175c66775f tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:47.921679 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-05610f83-a4d1-4b75-a56a-60175c66775f tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:48.007926 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-05610f83-a4d1-4b75-a56a-60175c66775f tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "POST /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee/action" status: 202 len: 0 microversion: 2.1 time: 0.099820 Apr 11 14:01:48.011933 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 376/747] 10.222.0.67 () {60 vars in 1277 bytes} [Mon Apr 11 14:01:47 2022] POST /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:01:48.017477 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c1c46e58-35b4-46f6-8cde-bfb904fcc44d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:48.019243 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c1c46e58-35b4-46f6-8cde-bfb904fcc44d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:48.036190 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c1c46e58-35b4-46f6-8cde-bfb904fcc44d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:48.036912 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c1c46e58-35b4-46f6-8cde-bfb904fcc44d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:48.040085 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c1c46e58-35b4-46f6-8cde-bfb904fcc44d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:48.043076 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c1c46e58-35b4-46f6-8cde-bfb904fcc44d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:48.244909 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c1c46e58-35b4-46f6-8cde-bfb904fcc44d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:48.252264 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c1c46e58-35b4-46f6-8cde-bfb904fcc44d tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1517 microversion: 2.1 time: 0.239205 Apr 11 14:01:48.252842 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 372/748] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:48 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:48.881724 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-eadac3bb-b5f3-4e4d-8eb5-4a27b058718a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:48.882343 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-eadac3bb-b5f3-4e4d-8eb5-4a27b058718a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:48.888246 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eadac3bb-b5f3-4e4d-8eb5-4a27b058718a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:48.888700 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eadac3bb-b5f3-4e4d-8eb5-4a27b058718a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:48.889463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eadac3bb-b5f3-4e4d-8eb5-4a27b058718a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:48.889902 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eadac3bb-b5f3-4e4d-8eb5-4a27b058718a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:49.026034 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-eadac3bb-b5f3-4e4d-8eb5-4a27b058718a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:49.034722 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-eadac3bb-b5f3-4e4d-8eb5-4a27b058718a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:49.036442 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-eadac3bb-b5f3-4e4d-8eb5-4a27b058718a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:49.038294 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-eadac3bb-b5f3-4e4d-8eb5-4a27b058718a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.161593 Apr 11 14:01:49.038867 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 377/749] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:48 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:49.272449 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f00f3ed0-1470-47ae-afe6-2a094f6b42f7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:49.273267 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f00f3ed0-1470-47ae-afe6-2a094f6b42f7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:49.281191 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f00f3ed0-1470-47ae-afe6-2a094f6b42f7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:49.281675 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f00f3ed0-1470-47ae-afe6-2a094f6b42f7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:49.282459 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f00f3ed0-1470-47ae-afe6-2a094f6b42f7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:49.282891 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f00f3ed0-1470-47ae-afe6-2a094f6b42f7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:49.423356 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f00f3ed0-1470-47ae-afe6-2a094f6b42f7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:49.431045 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f00f3ed0-1470-47ae-afe6-2a094f6b42f7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1517 microversion: 2.1 time: 0.164180 Apr 11 14:01:49.431621 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 373/750] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:49 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:49.890369 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1192968362", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1198794692", "security_groups": [{"name": "tempest-secgroup-smoke-1672236242"}], "block_device_mapping_v2": [{"uuid": "356b2bef-e929-4677-a22b-28870bc11eba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ad25a564-6f6a-4aa0-9d80-81636d1b0cca"}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:50.028824 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-18ff7c07-f0c7-4cc1-b132-416170fc7d2d req-8d5c5609-ba01-4d2f-8834-cc9a172487d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a988bf-9fbe-4371-a34f-2437494ec1ee", "name": "network-vif-unplugged", "status": "completed", "tag": "2f18b7d6-84d7-4249-8b95-51fdbd414e68"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:50.039337 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-18ff7c07-f0c7-4cc1-b132-416170fc7d2d req-8d5c5609-ba01-4d2f-8834-cc9a172487d9 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:50.041808 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] validate_networks() for [('ad25a564-6f6a-4aa0-9d80-81636d1b0cca', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 14:01:50.048162 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-18ff7c07-f0c7-4cc1-b132-416170fc7d2d req-8d5c5609-ba01-4d2f-8834-cc9a172487d9 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:50.067299 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.compute.server_external_events [req-18ff7c07-f0c7-4cc1-b132-416170fc7d2d req-8d5c5609-ba01-4d2f-8834-cc9a172487d9 service nova] Unable to find a host for instance e2a988bf-9fbe-4371-a34f-2437494ec1ee. Dropping event network-vif-unplugged {{(pid=116942) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 11 14:01:50.069122 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-18ff7c07-f0c7-4cc1-b132-416170fc7d2d req-8d5c5609-ba01-4d2f-8834-cc9a172487d9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044801 Apr 11 14:01:50.070471 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 374/751] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 11 14:01:50.075134 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1ee1ad8e-34da-40ee-8ef5-6d1cdcf3741f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:50.075988 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1ee1ad8e-34da-40ee-8ef5-6d1cdcf3741f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:50.082448 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ee1ad8e-34da-40ee-8ef5-6d1cdcf3741f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:50.083146 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ee1ad8e-34da-40ee-8ef5-6d1cdcf3741f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:50.084659 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ee1ad8e-34da-40ee-8ef5-6d1cdcf3741f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:50.085347 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ee1ad8e-34da-40ee-8ef5-6d1cdcf3741f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:50.268565 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1ee1ad8e-34da-40ee-8ef5-6d1cdcf3741f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:50.279438 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1ee1ad8e-34da-40ee-8ef5-6d1cdcf3741f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:50.281717 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1ee1ad8e-34da-40ee-8ef5-6d1cdcf3741f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:50.283072 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1ee1ad8e-34da-40ee-8ef5-6d1cdcf3741f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.211520 Apr 11 14:01:50.283816 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 375/752] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:50 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:50.449373 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b6c00cd9-8b6c-4b09-ac3d-51806dc595c9 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:50.450409 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b6c00cd9-8b6c-4b09-ac3d-51806dc595c9 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:50.458297 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b6c00cd9-8b6c-4b09-ac3d-51806dc595c9 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:50.459991 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b6c00cd9-8b6c-4b09-ac3d-51806dc595c9 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:50.461082 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b6c00cd9-8b6c-4b09-ac3d-51806dc595c9 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:50.461590 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b6c00cd9-8b6c-4b09-ac3d-51806dc595c9 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:50.609530 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 14:01:50.610323 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 14:01:50.611001 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 14:01:50.611643 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 14:01:50.612301 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 14:01:50.621934 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:50.622484 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:50.623394 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:50.623936 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:50.632499 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b6c00cd9-8b6c-4b09-ac3d-51806dc595c9 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:50.640675 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Getting quotas for project 40c040f0c3e74276bcab8dbc8e439de5. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:01:50.641040 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b6c00cd9-8b6c-4b09-ac3d-51806dc595c9 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1517 microversion: 2.1 time: 0.195727 Apr 11 14:01:50.641645 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 376/753] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:50 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1517 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:50.644780 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Getting quotas for user 64643f7804ba42f5886f949134dd4d06 and project 40c040f0c3e74276bcab8dbc8e439de5. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:01:50.706975 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 14:01:50.709798 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='356b2bef-e929-4677-a22b-28870bc11eba',volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 14:01:50.845031 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-aba536d5-8083-425c-8049-e5693a3e32ca tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.958685 Apr 11 14:01:50.845699 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 378/754] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 14:01:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 14:01:50.856273 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f618fd03-5cec-4014-85a4-4f3772010adf tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:50.857032 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f618fd03-5cec-4014-85a4-4f3772010adf tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:50.918036 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f618fd03-5cec-4014-85a4-4f3772010adf tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:50.925035 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f618fd03-5cec-4014-85a4-4f3772010adf tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1095 microversion: 2.1 time: 0.072577 Apr 11 14:01:50.925802 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 377/755] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:50 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:51.302877 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a89f4d7a-85e8-48d8-9d36-14f417895411 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:51.303513 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a89f4d7a-85e8-48d8-9d36-14f417895411 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:51.311276 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a89f4d7a-85e8-48d8-9d36-14f417895411 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:51.311765 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a89f4d7a-85e8-48d8-9d36-14f417895411 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:51.312548 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a89f4d7a-85e8-48d8-9d36-14f417895411 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:51.313162 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a89f4d7a-85e8-48d8-9d36-14f417895411 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:51.448002 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a89f4d7a-85e8-48d8-9d36-14f417895411 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:51.453910 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a89f4d7a-85e8-48d8-9d36-14f417895411 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:51.455417 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a89f4d7a-85e8-48d8-9d36-14f417895411 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:51.456837 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a89f4d7a-85e8-48d8-9d36-14f417895411 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.158432 Apr 11 14:01:51.457394 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 379/756] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:51 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:51.659506 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-18b3c5d4-24db-4e82-a43a-5450a450c1f2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:51.660166 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-18b3c5d4-24db-4e82-a43a-5450a450c1f2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:51.667157 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-18b3c5d4-24db-4e82-a43a-5450a450c1f2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:51.667596 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-18b3c5d4-24db-4e82-a43a-5450a450c1f2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:51.668382 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-18b3c5d4-24db-4e82-a43a-5450a450c1f2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:51.668811 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-18b3c5d4-24db-4e82-a43a-5450a450c1f2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:51.810856 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-18b3c5d4-24db-4e82-a43a-5450a450c1f2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:51.819198 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-18b3c5d4-24db-4e82-a43a-5450a450c1f2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1517 microversion: 2.1 time: 0.163321 Apr 11 14:01:51.831049 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 378/757] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:51 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1517 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:51.943794 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fbeaab6d-e8af-48fe-bc30-ae60d00a9464 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:51.944853 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fbeaab6d-e8af-48fe-bc30-ae60d00a9464 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:51.953563 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fbeaab6d-e8af-48fe-bc30-ae60d00a9464 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:51.954025 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fbeaab6d-e8af-48fe-bc30-ae60d00a9464 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:51.954823 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fbeaab6d-e8af-48fe-bc30-ae60d00a9464 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:51.955293 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fbeaab6d-e8af-48fe-bc30-ae60d00a9464 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:52.019396 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fbeaab6d-e8af-48fe-bc30-ae60d00a9464 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:52.027558 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fbeaab6d-e8af-48fe-bc30-ae60d00a9464 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1145 microversion: 2.1 time: 0.089006 Apr 11 14:01:52.028300 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 380/758] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:51 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:52.474246 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8f31ff84-e0a0-4daa-bf16-0bf2131600a6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:52.474856 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8f31ff84-e0a0-4daa-bf16-0bf2131600a6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:52.480749 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f31ff84-e0a0-4daa-bf16-0bf2131600a6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:52.481201 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f31ff84-e0a0-4daa-bf16-0bf2131600a6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:52.481967 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f31ff84-e0a0-4daa-bf16-0bf2131600a6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:52.482401 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f31ff84-e0a0-4daa-bf16-0bf2131600a6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:52.620045 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8f31ff84-e0a0-4daa-bf16-0bf2131600a6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:52.628001 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8f31ff84-e0a0-4daa-bf16-0bf2131600a6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:52.629500 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8f31ff84-e0a0-4daa-bf16-0bf2131600a6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:52.631245 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8f31ff84-e0a0-4daa-bf16-0bf2131600a6 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.160846 Apr 11 14:01:52.631966 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 379/759] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:52 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:52.838651 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cf6beb74-3688-45d5-a459-81d3adb93ed1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:52.839187 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cf6beb74-3688-45d5-a459-81d3adb93ed1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:52.845685 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf6beb74-3688-45d5-a459-81d3adb93ed1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:52.846140 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf6beb74-3688-45d5-a459-81d3adb93ed1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:52.847071 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf6beb74-3688-45d5-a459-81d3adb93ed1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:52.847389 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf6beb74-3688-45d5-a459-81d3adb93ed1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:52.987514 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cf6beb74-3688-45d5-a459-81d3adb93ed1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:52.996061 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cf6beb74-3688-45d5-a459-81d3adb93ed1 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1517 microversion: 2.1 time: 0.161297 Apr 11 14:01:52.996799 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 381/760] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:52 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:52.997676 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-caea41e0-fe31-470c-ab68-3b83c8c0ca12 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:52.998168 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-caea41e0-fe31-470c-ab68-3b83c8c0ca12 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:53.004690 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-caea41e0-fe31-470c-ab68-3b83c8c0ca12 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:53.005133 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-caea41e0-fe31-470c-ab68-3b83c8c0ca12 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:53.006923 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-caea41e0-fe31-470c-ab68-3b83c8c0ca12 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:53.007360 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-caea41e0-fe31-470c-ab68-3b83c8c0ca12 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:53.033390 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-caea41e0-fe31-470c-ab68-3b83c8c0ca12 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9/ips" status: 200 len: 151 microversion: 2.1 time: 0.039401 Apr 11 14:01:53.034007 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 380/761] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Apr 11 14:01:52 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:01:53.046739 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3fb7479e-c981-4d86-a1e0-5ae5f6e25958 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:53.047375 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3fb7479e-c981-4d86-a1e0-5ae5f6e25958 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:53.054134 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fb7479e-c981-4d86-a1e0-5ae5f6e25958 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:53.054707 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fb7479e-c981-4d86-a1e0-5ae5f6e25958 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:53.055821 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fb7479e-c981-4d86-a1e0-5ae5f6e25958 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:53.056386 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fb7479e-c981-4d86-a1e0-5ae5f6e25958 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:53.135608 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3fb7479e-c981-4d86-a1e0-5ae5f6e25958 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:53.147067 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3fb7479e-c981-4d86-a1e0-5ae5f6e25958 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1145 microversion: 2.1 time: 0.103832 Apr 11 14:01:53.151669 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 382/762] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:53 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1145 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:53.650350 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-927b9199-3739-40e1-b4db-0b450c21123b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:53.650886 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-927b9199-3739-40e1-b4db-0b450c21123b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:53.657709 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-927b9199-3739-40e1-b4db-0b450c21123b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:53.658162 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-927b9199-3739-40e1-b4db-0b450c21123b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:53.659193 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-927b9199-3739-40e1-b4db-0b450c21123b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:53.659719 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-927b9199-3739-40e1-b4db-0b450c21123b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:53.799259 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-927b9199-3739-40e1-b4db-0b450c21123b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:53.808641 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-927b9199-3739-40e1-b4db-0b450c21123b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:53.810151 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-927b9199-3739-40e1-b4db-0b450c21123b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:53.811333 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-927b9199-3739-40e1-b4db-0b450c21123b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.165283 Apr 11 14:01:53.813063 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 381/763] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:53 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:54.014765 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d2dbe2f2-358f-46e1-8cc5-ce9374c0db26 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:54.015398 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d2dbe2f2-358f-46e1-8cc5-ce9374c0db26 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:54.023339 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2dbe2f2-358f-46e1-8cc5-ce9374c0db26 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:54.024054 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2dbe2f2-358f-46e1-8cc5-ce9374c0db26 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:54.024854 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2dbe2f2-358f-46e1-8cc5-ce9374c0db26 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:54.025649 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2dbe2f2-358f-46e1-8cc5-ce9374c0db26 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:54.164630 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e65b99be-723f-4571-a996-ae76a272af36 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:54.165297 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e65b99be-723f-4571-a996-ae76a272af36 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:54.166639 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d2dbe2f2-358f-46e1-8cc5-ce9374c0db26 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:54.172405 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e65b99be-723f-4571-a996-ae76a272af36 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:54.172861 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e65b99be-723f-4571-a996-ae76a272af36 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:54.173640 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e65b99be-723f-4571-a996-ae76a272af36 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:54.174044 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d2dbe2f2-358f-46e1-8cc5-ce9374c0db26 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1517 microversion: 2.1 time: 0.163800 Apr 11 14:01:54.174150 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e65b99be-723f-4571-a996-ae76a272af36 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:54.174638 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 383/764] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:54 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:54.239443 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e65b99be-723f-4571-a996-ae76a272af36 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:54.248074 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e65b99be-723f-4571-a996-ae76a272af36 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1145 microversion: 2.1 time: 0.087717 Apr 11 14:01:54.248857 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 382/765] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:54 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:54.425747 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-eea5ea12-ef3f-4b17-b18c-44c76275fc96 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba7499e9-f494-4509-b60a-52f63de6ab10"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:54.426870 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-eea5ea12-ef3f-4b17-b18c-44c76275fc96 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:54.433583 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eea5ea12-ef3f-4b17-b18c-44c76275fc96 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:54.434034 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eea5ea12-ef3f-4b17-b18c-44c76275fc96 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:54.434807 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eea5ea12-ef3f-4b17-b18c-44c76275fc96 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:54.435244 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eea5ea12-ef3f-4b17-b18c-44c76275fc96 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:54.831257 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0ab13ab0-b3af-448c-8f89-088ae05246eb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:54.831899 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0ab13ab0-b3af-448c-8f89-088ae05246eb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:54.838604 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ab13ab0-b3af-448c-8f89-088ae05246eb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:54.839043 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ab13ab0-b3af-448c-8f89-088ae05246eb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:54.839837 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ab13ab0-b3af-448c-8f89-088ae05246eb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:54.840268 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0ab13ab0-b3af-448c-8f89-088ae05246eb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:54.994907 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0ab13ab0-b3af-448c-8f89-088ae05246eb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:55.004456 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0ab13ab0-b3af-448c-8f89-088ae05246eb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:55.007371 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0ab13ab0-b3af-448c-8f89-088ae05246eb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:55.008846 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0ab13ab0-b3af-448c-8f89-088ae05246eb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.182323 Apr 11 14:01:55.009943 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 383/766] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:54 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:55.190293 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b28ca538-27b2-4eb3-b622-8436b0f10257 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:55.191007 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b28ca538-27b2-4eb3-b622-8436b0f10257 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:55.198472 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b28ca538-27b2-4eb3-b622-8436b0f10257 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:55.198958 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b28ca538-27b2-4eb3-b622-8436b0f10257 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:55.199766 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b28ca538-27b2-4eb3-b622-8436b0f10257 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:55.200203 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b28ca538-27b2-4eb3-b622-8436b0f10257 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:55.490745 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b28ca538-27b2-4eb3-b622-8436b0f10257 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:55.499404 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b28ca538-27b2-4eb3-b622-8436b0f10257 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1517 microversion: 2.1 time: 0.312919 Apr 11 14:01:55.502832 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 384/767] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:55 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1517 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:55.505919 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3469ed61-6f0d-4e2e-b696-23447455e5c9 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:55.506590 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3469ed61-6f0d-4e2e-b696-23447455e5c9 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:55.512717 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3469ed61-6f0d-4e2e-b696-23447455e5c9 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:55.513171 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3469ed61-6f0d-4e2e-b696-23447455e5c9 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:55.514042 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3469ed61-6f0d-4e2e-b696-23447455e5c9 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:55.514390 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3469ed61-6f0d-4e2e-b696-23447455e5c9 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:55.582802 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-3469ed61-6f0d-4e2e-b696-23447455e5c9 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:55.590661 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3469ed61-6f0d-4e2e-b696-23447455e5c9 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1145 microversion: 2.1 time: 0.089606 Apr 11 14:01:55.591416 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 385/768] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:55 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:56.028211 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-70ede8f1-26bf-496c-ba75-5c1e065721e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:56.028814 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-70ede8f1-26bf-496c-ba75-5c1e065721e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:56.034610 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-70ede8f1-26bf-496c-ba75-5c1e065721e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:56.035053 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-70ede8f1-26bf-496c-ba75-5c1e065721e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:56.035845 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-70ede8f1-26bf-496c-ba75-5c1e065721e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:56.036936 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-70ede8f1-26bf-496c-ba75-5c1e065721e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:56.176219 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-70ede8f1-26bf-496c-ba75-5c1e065721e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:56.185375 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-70ede8f1-26bf-496c-ba75-5c1e065721e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:56.186865 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-70ede8f1-26bf-496c-ba75-5c1e065721e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:56.188071 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-70ede8f1-26bf-496c-ba75-5c1e065721e1 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.163915 Apr 11 14:01:56.189011 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 386/769] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:56 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:01:56.516660 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8b5d83f8-4d15-418d-9b88-5ff640a19c00 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:56.517280 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8b5d83f8-4d15-418d-9b88-5ff640a19c00 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:56.524416 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8b5d83f8-4d15-418d-9b88-5ff640a19c00 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:56.525122 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8b5d83f8-4d15-418d-9b88-5ff640a19c00 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:56.526051 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8b5d83f8-4d15-418d-9b88-5ff640a19c00 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:56.526486 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8b5d83f8-4d15-418d-9b88-5ff640a19c00 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:56.655711 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8b5d83f8-4d15-418d-9b88-5ff640a19c00 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:56.663414 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8b5d83f8-4d15-418d-9b88-5ff640a19c00 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1517 microversion: 2.1 time: 0.150591 Apr 11 14:01:56.664063 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 387/770] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:56 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:56.668526 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2f2a5311-b5dd-4430-9e35-0e5503e337c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:56.669133 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2f2a5311-b5dd-4430-9e35-0e5503e337c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:56.674562 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f2a5311-b5dd-4430-9e35-0e5503e337c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:56.675003 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f2a5311-b5dd-4430-9e35-0e5503e337c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:56.675801 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f2a5311-b5dd-4430-9e35-0e5503e337c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:56.676231 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f2a5311-b5dd-4430-9e35-0e5503e337c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:56.745124 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2f2a5311-b5dd-4430-9e35-0e5503e337c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:56.752406 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2f2a5311-b5dd-4430-9e35-0e5503e337c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1145 microversion: 2.1 time: 0.087421 Apr 11 14:01:56.752971 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 388/771] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:56 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:57.206645 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c157c184-6349-4336-b3f3-66edd684f11a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:57.207285 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c157c184-6349-4336-b3f3-66edd684f11a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:57.213206 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c157c184-6349-4336-b3f3-66edd684f11a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:57.213651 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c157c184-6349-4336-b3f3-66edd684f11a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:57.214402 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c157c184-6349-4336-b3f3-66edd684f11a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:57.214827 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c157c184-6349-4336-b3f3-66edd684f11a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:57.367275 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c157c184-6349-4336-b3f3-66edd684f11a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:57.375403 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c157c184-6349-4336-b3f3-66edd684f11a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:57.377011 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c157c184-6349-4336-b3f3-66edd684f11a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:57.378191 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c157c184-6349-4336-b3f3-66edd684f11a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.175524 Apr 11 14:01:57.388871 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 389/772] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:57 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:01:57.436860 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-eea5ea12-ef3f-4b17-b18c-44c76275fc96 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "POST /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.015019 Apr 11 14:01:57.437651 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 384/773] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 14:01:54 2022] POST /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9/os-volume_attachments => generated 194 bytes in 3017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:01:57.680758 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-53992e9c-e120-430b-8b6e-e646f0d0f7bc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:57.681386 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-53992e9c-e120-430b-8b6e-e646f0d0f7bc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:57.687708 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-53992e9c-e120-430b-8b6e-e646f0d0f7bc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:57.688166 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-53992e9c-e120-430b-8b6e-e646f0d0f7bc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:57.688938 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-53992e9c-e120-430b-8b6e-e646f0d0f7bc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:57.689379 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-53992e9c-e120-430b-8b6e-e646f0d0f7bc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:57.771014 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-83bbec6e-3289-4860-b57d-6cf86a7481f8 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:57.772032 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-83bbec6e-3289-4860-b57d-6cf86a7481f8 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:57.778451 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83bbec6e-3289-4860-b57d-6cf86a7481f8 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:57.778904 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83bbec6e-3289-4860-b57d-6cf86a7481f8 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:57.779734 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83bbec6e-3289-4860-b57d-6cf86a7481f8 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:57.780175 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83bbec6e-3289-4860-b57d-6cf86a7481f8 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:57.818059 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-53992e9c-e120-430b-8b6e-e646f0d0f7bc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:57.825580 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-53992e9c-e120-430b-8b6e-e646f0d0f7bc tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1519 microversion: 2.1 time: 0.148796 Apr 11 14:01:57.826267 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 390/774] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:57 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:57.841406 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-83bbec6e-3289-4860-b57d-6cf86a7481f8 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:57.848703 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-83bbec6e-3289-4860-b57d-6cf86a7481f8 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1137 microversion: 2.1 time: 0.082796 Apr 11 14:01:57.849267 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 385/775] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:57 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:58.260557 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7d728fbb-e377-4ebd-822b-465f04f83c61 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:58.261156 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7d728fbb-e377-4ebd-822b-465f04f83c61 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:58.267599 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7d728fbb-e377-4ebd-822b-465f04f83c61 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:58.268147 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7d728fbb-e377-4ebd-822b-465f04f83c61 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:58.268911 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7d728fbb-e377-4ebd-822b-465f04f83c61 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:58.269372 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7d728fbb-e377-4ebd-822b-465f04f83c61 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:58.294961 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7d728fbb-e377-4ebd-822b-465f04f83c61 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/ips" status: 200 len: 147 microversion: 2.1 time: 0.149983 Apr 11 14:01:58.295516 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 391/776] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Apr 11 14:01:58 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/ips => generated 147 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:01:58.396815 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a7da3345-c8bb-4536-a6c1-1af239a3c57c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:58.397463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a7da3345-c8bb-4536-a6c1-1af239a3c57c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:58.407162 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a7da3345-c8bb-4536-a6c1-1af239a3c57c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:58.407841 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a7da3345-c8bb-4536-a6c1-1af239a3c57c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:58.408815 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a7da3345-c8bb-4536-a6c1-1af239a3c57c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:58.409415 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a7da3345-c8bb-4536-a6c1-1af239a3c57c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:58.640368 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a7da3345-c8bb-4536-a6c1-1af239a3c57c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:58.654286 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a7da3345-c8bb-4536-a6c1-1af239a3c57c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:58.656006 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a7da3345-c8bb-4536-a6c1-1af239a3c57c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:58.657309 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a7da3345-c8bb-4536-a6c1-1af239a3c57c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.264651 Apr 11 14:01:58.669868 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 386/777] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:58 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:58.842252 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a6b702dc-302c-4644-b643-65797a2f7b91 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:58.842865 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a6b702dc-302c-4644-b643-65797a2f7b91 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:58.849081 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a6b702dc-302c-4644-b643-65797a2f7b91 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:58.849581 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a6b702dc-302c-4644-b643-65797a2f7b91 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:58.850475 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a6b702dc-302c-4644-b643-65797a2f7b91 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:58.850909 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a6b702dc-302c-4644-b643-65797a2f7b91 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:58.865622 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2fb4d940-127c-469a-8df4-6c2ada0b252e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:58.866317 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2fb4d940-127c-469a-8df4-6c2ada0b252e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:58.872316 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2fb4d940-127c-469a-8df4-6c2ada0b252e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:58.872998 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2fb4d940-127c-469a-8df4-6c2ada0b252e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:58.874018 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2fb4d940-127c-469a-8df4-6c2ada0b252e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:58.874475 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2fb4d940-127c-469a-8df4-6c2ada0b252e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:58.940156 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2fb4d940-127c-469a-8df4-6c2ada0b252e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:58.948217 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2fb4d940-127c-469a-8df4-6c2ada0b252e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1211 microversion: 2.1 time: 0.086696 Apr 11 14:01:58.948812 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 387/778] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:58 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:01:59.088883 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a6b702dc-302c-4644-b643-65797a2f7b91 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:59.097922 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a6b702dc-302c-4644-b643-65797a2f7b91 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1575 microversion: 2.1 time: 0.259453 Apr 11 14:01:59.098509 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 392/779] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:58 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1575 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:01:59.676349 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0da0324a-d758-4505-9ee9-dc599f17efe9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:59.677026 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0da0324a-d758-4505-9ee9-dc599f17efe9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:59.685783 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0da0324a-d758-4505-9ee9-dc599f17efe9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:59.686373 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0da0324a-d758-4505-9ee9-dc599f17efe9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:59.688055 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0da0324a-d758-4505-9ee9-dc599f17efe9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:59.688659 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0da0324a-d758-4505-9ee9-dc599f17efe9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:59.807154 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6474608f-dbf6-4000-9f75-cd7cd71faf15 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcbddcf3-f162-4f81-96a7-c741cad5764b"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:01:59.808586 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6474608f-dbf6-4000-9f75-cd7cd71faf15 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:59.815708 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6474608f-dbf6-4000-9f75-cd7cd71faf15 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:59.817039 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6474608f-dbf6-4000-9f75-cd7cd71faf15 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:59.818020 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6474608f-dbf6-4000-9f75-cd7cd71faf15 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:59.818650 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6474608f-dbf6-4000-9f75-cd7cd71faf15 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:59.847310 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0da0324a-d758-4505-9ee9-dc599f17efe9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:59.856820 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0da0324a-d758-4505-9ee9-dc599f17efe9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:59.858704 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0da0324a-d758-4505-9ee9-dc599f17efe9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:01:59.861285 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0da0324a-d758-4505-9ee9-dc599f17efe9 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.189419 Apr 11 14:01:59.861885 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 388/780] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:01:59 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:01:59.969071 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7f35719d-8c85-4f1e-9488-e104aba36386 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:01:59.970713 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7f35719d-8c85-4f1e-9488-e104aba36386 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:01:59.979510 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7f35719d-8c85-4f1e-9488-e104aba36386 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:59.996056 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7f35719d-8c85-4f1e-9488-e104aba36386 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:01:59.997342 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7f35719d-8c85-4f1e-9488-e104aba36386 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:01:59.998340 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7f35719d-8c85-4f1e-9488-e104aba36386 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:00.105381 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6474608f-dbf6-4000-9f75-cd7cd71faf15 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "POST /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302255 Apr 11 14:02:00.107001 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 393/781] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 14:01:59 2022] POST /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:02:00.118099 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fb37521c-5dc1-4e03-9e01-067137413db4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:00.119273 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fb37521c-5dc1-4e03-9e01-067137413db4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:00.130374 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fb37521c-5dc1-4e03-9e01-067137413db4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:00.131915 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fb37521c-5dc1-4e03-9e01-067137413db4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:00.133146 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fb37521c-5dc1-4e03-9e01-067137413db4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:00.133790 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fb37521c-5dc1-4e03-9e01-067137413db4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:00.228031 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7f35719d-8c85-4f1e-9488-e104aba36386 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:00.236837 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7f35719d-8c85-4f1e-9488-e104aba36386 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1279 microversion: 2.1 time: 0.274059 Apr 11 14:02:00.246114 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 389/782] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:01:59 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1279 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:00.355570 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fb37521c-5dc1-4e03-9e01-067137413db4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:00.363342 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fb37521c-5dc1-4e03-9e01-067137413db4 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1575 microversion: 2.1 time: 0.250519 Apr 11 14:02:00.374861 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 394/783] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:00 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1575 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:00.652460 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-55322557-f9bc-4b83-bf28-4addbc697fd3 req-eede3b32-3bc7-42c4-be9a-ae77a6e87fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3758fe41-ad1e-4bbb-a152-9cc831519aca", "tag": "64a97990-f586-4554-ba0f-e0bf82738eaf"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:00.662777 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-55322557-f9bc-4b83-bf28-4addbc697fd3 req-eede3b32-3bc7-42c4-be9a-ae77a6e87fb7 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:00.663482 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-55322557-f9bc-4b83-bf28-4addbc697fd3 req-eede3b32-3bc7-42c4-be9a-ae77a6e87fb7 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:00.683256 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-55322557-f9bc-4b83-bf28-4addbc697fd3 req-eede3b32-3bc7-42c4-be9a-ae77a6e87fb7 service nova] Creating event network-changed:64a97990-f586-4554-ba0f-e0bf82738eaf for instance 3758fe41-ad1e-4bbb-a152-9cc831519aca on hv-cinder-83078 Apr 11 14:02:00.690973 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-55322557-f9bc-4b83-bf28-4addbc697fd3 req-eede3b32-3bc7-42c4-be9a-ae77a6e87fb7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044591 Apr 11 14:02:00.692247 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 390/784] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:00.880008 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7b819795-66c2-4d0e-88fb-1b5f41cae7cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:00.881150 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7b819795-66c2-4d0e-88fb-1b5f41cae7cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:00.887446 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7b819795-66c2-4d0e-88fb-1b5f41cae7cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:00.887929 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7b819795-66c2-4d0e-88fb-1b5f41cae7cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:00.888702 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7b819795-66c2-4d0e-88fb-1b5f41cae7cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:00.889235 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7b819795-66c2-4d0e-88fb-1b5f41cae7cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:01.105634 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7b819795-66c2-4d0e-88fb-1b5f41cae7cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:01.113354 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7b819795-66c2-4d0e-88fb-1b5f41cae7cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:01.114855 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7b819795-66c2-4d0e-88fb-1b5f41cae7cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:01.116361 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7b819795-66c2-4d0e-88fb-1b5f41cae7cb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.240352 Apr 11 14:02:01.116933 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 395/785] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:02:00 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:02:01.254114 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e7282f85-8bf3-4db0-9f78-ea6098570cef tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:01.254823 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e7282f85-8bf3-4db0-9f78-ea6098570cef tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:01.261385 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e7282f85-8bf3-4db0-9f78-ea6098570cef tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:01.261841 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e7282f85-8bf3-4db0-9f78-ea6098570cef tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:01.262617 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e7282f85-8bf3-4db0-9f78-ea6098570cef tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:01.263059 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e7282f85-8bf3-4db0-9f78-ea6098570cef tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:01.381649 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-06e6c46c-49cd-4e6b-98a5-5e2d7edc9548 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:01.382689 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-06e6c46c-49cd-4e6b-98a5-5e2d7edc9548 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:01.388814 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06e6c46c-49cd-4e6b-98a5-5e2d7edc9548 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:01.389384 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06e6c46c-49cd-4e6b-98a5-5e2d7edc9548 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:01.390456 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06e6c46c-49cd-4e6b-98a5-5e2d7edc9548 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:01.390783 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06e6c46c-49cd-4e6b-98a5-5e2d7edc9548 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:01.398528 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e7282f85-8bf3-4db0-9f78-ea6098570cef tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:01.406610 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e7282f85-8bf3-4db0-9f78-ea6098570cef tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1279 microversion: 2.1 time: 0.156658 Apr 11 14:02:01.407292 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 391/786] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:01 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:01.856368 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-06e6c46c-49cd-4e6b-98a5-5e2d7edc9548 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:01.863608 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-06e6c46c-49cd-4e6b-98a5-5e2d7edc9548 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1575 microversion: 2.1 time: 0.486352 Apr 11 14:02:01.864200 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 396/787] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:01 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1575 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:02:02.114478 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-a2de9fed-07ca-478e-94a8-e7b06c7ab26f req-e5477803-2b62-446b-a1d3-5b05e98752fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf497683-01c3-4106-adb0-36d23d564607", "name": "network-vif-plugged", "status": "completed", "tag": "9c6a342b-a134-4ab5-996e-3eab3c406817"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:02.123714 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-a2de9fed-07ca-478e-94a8-e7b06c7ab26f req-e5477803-2b62-446b-a1d3-5b05e98752fb service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:02.124181 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-a2de9fed-07ca-478e-94a8-e7b06c7ab26f req-e5477803-2b62-446b-a1d3-5b05e98752fb service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:02.135249 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2809f843-286a-486e-ae32-75af845fbb5d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:02.135897 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2809f843-286a-486e-ae32-75af845fbb5d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:02.136408 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-a2de9fed-07ca-478e-94a8-e7b06c7ab26f req-e5477803-2b62-446b-a1d3-5b05e98752fb service nova] Creating event network-vif-plugged:9c6a342b-a134-4ab5-996e-3eab3c406817 for instance cf497683-01c3-4106-adb0-36d23d564607 on hv-cinder-83078 Apr 11 14:02:02.141278 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-a2de9fed-07ca-478e-94a8-e7b06c7ab26f req-e5477803-2b62-446b-a1d3-5b05e98752fb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030417 Apr 11 14:02:02.141999 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 392/788] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:02.143011 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2809f843-286a-486e-ae32-75af845fbb5d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:02.143467 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2809f843-286a-486e-ae32-75af845fbb5d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:02.144273 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2809f843-286a-486e-ae32-75af845fbb5d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:02.144716 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2809f843-286a-486e-ae32-75af845fbb5d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:02.303509 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2809f843-286a-486e-ae32-75af845fbb5d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:02.311491 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2809f843-286a-486e-ae32-75af845fbb5d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:02.313019 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2809f843-286a-486e-ae32-75af845fbb5d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:02.314223 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2809f843-286a-486e-ae32-75af845fbb5d tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.183696 Apr 11 14:02:02.314785 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 397/789] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:02:02 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:02:02.424071 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-55655419-0b30-4baf-b04d-61db2d75bae1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:02.424782 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-55655419-0b30-4baf-b04d-61db2d75bae1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:02.431146 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-55655419-0b30-4baf-b04d-61db2d75bae1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:02.431605 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-55655419-0b30-4baf-b04d-61db2d75bae1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:02.432407 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-55655419-0b30-4baf-b04d-61db2d75bae1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:02.432848 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-55655419-0b30-4baf-b04d-61db2d75bae1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:02.561539 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-55655419-0b30-4baf-b04d-61db2d75bae1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:02.570132 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-55655419-0b30-4baf-b04d-61db2d75bae1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1279 microversion: 2.1 time: 0.150366 Apr 11 14:02:02.570714 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 393/790] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:02 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1279 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:02.881194 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c999bd32-85e2-4e3e-9e01-e2e795a0ceec tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:02.882020 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c999bd32-85e2-4e3e-9e01-e2e795a0ceec tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:02.888370 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c999bd32-85e2-4e3e-9e01-e2e795a0ceec tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:02.888825 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c999bd32-85e2-4e3e-9e01-e2e795a0ceec tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:02.889598 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c999bd32-85e2-4e3e-9e01-e2e795a0ceec tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:02.890042 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c999bd32-85e2-4e3e-9e01-e2e795a0ceec tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:03.016209 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c999bd32-85e2-4e3e-9e01-e2e795a0ceec tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:03.023906 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c999bd32-85e2-4e3e-9e01-e2e795a0ceec tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1575 microversion: 2.1 time: 0.147246 Apr 11 14:02:03.024712 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 398/791] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:02 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:03.333145 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cb350a23-455e-4126-b061-4cc7f94adb43 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:03.334044 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cb350a23-455e-4126-b061-4cc7f94adb43 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:03.340486 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb350a23-455e-4126-b061-4cc7f94adb43 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:03.341019 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb350a23-455e-4126-b061-4cc7f94adb43 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:03.341867 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb350a23-455e-4126-b061-4cc7f94adb43 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:03.342390 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb350a23-455e-4126-b061-4cc7f94adb43 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:03.472234 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cb350a23-455e-4126-b061-4cc7f94adb43 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:03.481014 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cb350a23-455e-4126-b061-4cc7f94adb43 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:03.482530 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cb350a23-455e-4126-b061-4cc7f94adb43 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:03.483771 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cb350a23-455e-4126-b061-4cc7f94adb43 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1730 microversion: 2.20 time: 0.154551 Apr 11 14:02:03.484742 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 394/792] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:02:03 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:02:03.586881 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-38ecf005-c24f-48da-9500-8b41e40bd4e2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:03.587509 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-38ecf005-c24f-48da-9500-8b41e40bd4e2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:03.593302 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-38ecf005-c24f-48da-9500-8b41e40bd4e2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:03.593755 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-38ecf005-c24f-48da-9500-8b41e40bd4e2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:03.594532 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-38ecf005-c24f-48da-9500-8b41e40bd4e2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:03.595241 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-38ecf005-c24f-48da-9500-8b41e40bd4e2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:03.731798 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-38ecf005-c24f-48da-9500-8b41e40bd4e2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:03.739302 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-38ecf005-c24f-48da-9500-8b41e40bd4e2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1279 microversion: 2.1 time: 0.156991 Apr 11 14:02:03.740199 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 399/793] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:03 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:04.041116 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-82ab3943-7947-454f-968f-87bb190ecd0e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:04.041742 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-82ab3943-7947-454f-968f-87bb190ecd0e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:04.048382 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-82ab3943-7947-454f-968f-87bb190ecd0e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:04.048897 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-82ab3943-7947-454f-968f-87bb190ecd0e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:04.049754 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-82ab3943-7947-454f-968f-87bb190ecd0e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:04.050435 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-82ab3943-7947-454f-968f-87bb190ecd0e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:04.180725 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-82ab3943-7947-454f-968f-87bb190ecd0e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:04.188216 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-82ab3943-7947-454f-968f-87bb190ecd0e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1575 microversion: 2.1 time: 0.151054 Apr 11 14:02:04.188786 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 395/794] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:04 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:04.502575 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-37025bb9-56ce-4004-a30d-7b60d86dbcbb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:04.503190 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-37025bb9-56ce-4004-a30d-7b60d86dbcbb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:04.510272 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37025bb9-56ce-4004-a30d-7b60d86dbcbb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:04.511161 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37025bb9-56ce-4004-a30d-7b60d86dbcbb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:04.511995 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37025bb9-56ce-4004-a30d-7b60d86dbcbb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:04.512715 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37025bb9-56ce-4004-a30d-7b60d86dbcbb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:04.645204 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-37025bb9-56ce-4004-a30d-7b60d86dbcbb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:04.654115 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-37025bb9-56ce-4004-a30d-7b60d86dbcbb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:04.655599 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-37025bb9-56ce-4004-a30d-7b60d86dbcbb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:04.656768 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-37025bb9-56ce-4004-a30d-7b60d86dbcbb tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1717 microversion: 2.20 time: 0.159065 Apr 11 14:02:04.657320 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 400/795] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:02:04 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:02:04.756297 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-30d7c63e-43c1-4ac6-a3f9-9e574045bae4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:04.756911 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-30d7c63e-43c1-4ac6-a3f9-9e574045bae4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:04.763136 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-30d7c63e-43c1-4ac6-a3f9-9e574045bae4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:04.763586 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-30d7c63e-43c1-4ac6-a3f9-9e574045bae4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:04.764376 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-30d7c63e-43c1-4ac6-a3f9-9e574045bae4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:04.764807 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-30d7c63e-43c1-4ac6-a3f9-9e574045bae4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:04.895487 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-30d7c63e-43c1-4ac6-a3f9-9e574045bae4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:04.903600 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-30d7c63e-43c1-4ac6-a3f9-9e574045bae4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1279 microversion: 2.1 time: 0.151653 Apr 11 14:02:04.904242 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 396/796] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:04 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1279 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:05.051566 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-261a43e1-fedc-41a8-9394-0ba103f9e60e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Action: 'create', calling method: .version_select at 0x7f730bb40430>, body: {"keypair": {"name": "tempest-keypair-892962934"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:05.065003 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-261a43e1-fedc-41a8-9394-0ba103f9e60e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:02:05.068814 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-261a43e1-fedc-41a8-9394-0ba103f9e60e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for user 2cbcdc40fea745f48e1dfc62a732b7ee and project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:02:05.133059 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-261a43e1-fedc-41a8-9394-0ba103f9e60e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:02:05.136625 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-261a43e1-fedc-41a8-9394-0ba103f9e60e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for user 2cbcdc40fea745f48e1dfc62a732b7ee and project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:02:05.150057 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-261a43e1-fedc-41a8-9394-0ba103f9e60e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.102210 Apr 11 14:02:05.150600 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 401/797] 10.222.0.67 () {60 vars in 1157 bytes} [Mon Apr 11 14:02:05 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:05.206062 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2cbf7936-bc6b-4e6a-bf86-57a9fddeddbe tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:05.206625 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2cbf7936-bc6b-4e6a-bf86-57a9fddeddbe tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:05.213170 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2cbf7936-bc6b-4e6a-bf86-57a9fddeddbe tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:05.213627 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2cbf7936-bc6b-4e6a-bf86-57a9fddeddbe tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:05.214410 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2cbf7936-bc6b-4e6a-bf86-57a9fddeddbe tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:05.214852 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2cbf7936-bc6b-4e6a-bf86-57a9fddeddbe tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:05.404205 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2cbf7936-bc6b-4e6a-bf86-57a9fddeddbe tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:05.412781 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2cbf7936-bc6b-4e6a-bf86-57a9fddeddbe tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1575 microversion: 2.1 time: 0.210708 Apr 11 14:02:05.413562 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 397/798] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:05 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:05.921365 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c85e768d-e964-46b0-864b-2b9650730992 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:05.922018 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c85e768d-e964-46b0-864b-2b9650730992 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:05.928454 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c85e768d-e964-46b0-864b-2b9650730992 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:05.928907 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c85e768d-e964-46b0-864b-2b9650730992 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:05.929683 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c85e768d-e964-46b0-864b-2b9650730992 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:05.930121 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c85e768d-e964-46b0-864b-2b9650730992 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:06.142599 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c85e768d-e964-46b0-864b-2b9650730992 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:06.150380 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c85e768d-e964-46b0-864b-2b9650730992 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1267 microversion: 2.1 time: 0.233403 Apr 11 14:02:06.151031 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 402/799] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:05 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:06.430717 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1f04ccc0-6eec-41a7-9c6b-1a5e9c5364b2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:06.431369 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1f04ccc0-6eec-41a7-9c6b-1a5e9c5364b2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:06.437645 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f04ccc0-6eec-41a7-9c6b-1a5e9c5364b2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:06.438108 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f04ccc0-6eec-41a7-9c6b-1a5e9c5364b2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:06.438887 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f04ccc0-6eec-41a7-9c6b-1a5e9c5364b2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:06.439337 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f04ccc0-6eec-41a7-9c6b-1a5e9c5364b2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:06.567589 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1593052786", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "730a24f2-5d00-49fb-895d-b884d9163131"}], "security_groups": [{"name": "tempest-securitygroup--440647083"}], "key_name": "tempest-keypair-892962934", "user_data": "}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:06.580190 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1f04ccc0-6eec-41a7-9c6b-1a5e9c5364b2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:06.589203 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1f04ccc0-6eec-41a7-9c6b-1a5e9c5364b2 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1575 microversion: 2.1 time: 0.162796 Apr 11 14:02:06.589769 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 398/800] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:06 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:06.671987 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] validate_networks() for [('730a24f2-5d00-49fb-895d-b884d9163131', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 14:02:07.030694 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 14:02:07.031265 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 14:02:07.031604 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 14:02:07.032052 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 14:02:07.032460 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 14:02:07.041452 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:07.041892 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:07.042678 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:07.043109 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:07.058537 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:02:07.062451 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for user 2cbcdc40fea745f48e1dfc62a732b7ee and project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:02:07.073590 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 14:02:07.075869 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 14:02:07.119715 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ad7da79b-2deb-447d-b894-617ecef6ad29 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.556288 Apr 11 14:02:07.120361 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 403/801] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 14:02:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 11 14:02:07.130715 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-308cbde2-b0e8-4dd4-881a-d0a568b36a68 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:07.131682 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-308cbde2-b0e8-4dd4-881a-d0a568b36a68 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:07.167994 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fe2bc400-9109-4bee-8d23-53754fbc4539 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:07.168612 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fe2bc400-9109-4bee-8d23-53754fbc4539 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:07.174571 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fe2bc400-9109-4bee-8d23-53754fbc4539 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:07.175024 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fe2bc400-9109-4bee-8d23-53754fbc4539 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:07.175833 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fe2bc400-9109-4bee-8d23-53754fbc4539 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:07.176261 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fe2bc400-9109-4bee-8d23-53754fbc4539 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:07.186914 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-308cbde2-b0e8-4dd4-881a-d0a568b36a68 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:07.195229 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-308cbde2-b0e8-4dd4-881a-d0a568b36a68 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 200 len: 1241 microversion: 2.1 time: 0.068772 Apr 11 14:02:07.195837 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 399/802] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:07 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:02:07.315007 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fe2bc400-9109-4bee-8d23-53754fbc4539 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:07.323115 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fe2bc400-9109-4bee-8d23-53754fbc4539 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1267 microversion: 2.1 time: 0.159246 Apr 11 14:02:07.323900 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 404/803] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:07 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:07.606296 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-768ee4d7-8d97-4a3c-8d6f-a4d6ac4339a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:07.606908 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-768ee4d7-8d97-4a3c-8d6f-a4d6ac4339a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:07.613289 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-768ee4d7-8d97-4a3c-8d6f-a4d6ac4339a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:07.613746 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-768ee4d7-8d97-4a3c-8d6f-a4d6ac4339a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:07.615086 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-768ee4d7-8d97-4a3c-8d6f-a4d6ac4339a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:07.615529 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-768ee4d7-8d97-4a3c-8d6f-a4d6ac4339a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:07.746958 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-768ee4d7-8d97-4a3c-8d6f-a4d6ac4339a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:07.754333 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-768ee4d7-8d97-4a3c-8d6f-a4d6ac4339a0 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1575 microversion: 2.1 time: 0.151944 Apr 11 14:02:07.754935 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 400/804] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:07 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:08.213303 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b1f8242c-47f3-49a1-b218-a66650e506b3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:08.214616 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b1f8242c-47f3-49a1-b218-a66650e506b3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:08.221162 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1f8242c-47f3-49a1-b218-a66650e506b3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:08.221607 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1f8242c-47f3-49a1-b218-a66650e506b3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:08.222379 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1f8242c-47f3-49a1-b218-a66650e506b3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:08.222807 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1f8242c-47f3-49a1-b218-a66650e506b3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:08.313766 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b1f8242c-47f3-49a1-b218-a66650e506b3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:08.321537 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b1f8242c-47f3-49a1-b218-a66650e506b3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 200 len: 1299 microversion: 2.1 time: 0.112124 Apr 11 14:02:08.322113 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 405/805] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:08 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:08.340175 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-49f4cdc6-8a26-496c-9380-e8b0ae69d101 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:08.340798 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-49f4cdc6-8a26-496c-9380-e8b0ae69d101 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:08.346592 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-49f4cdc6-8a26-496c-9380-e8b0ae69d101 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:08.347051 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-49f4cdc6-8a26-496c-9380-e8b0ae69d101 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:08.347855 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-49f4cdc6-8a26-496c-9380-e8b0ae69d101 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:08.348298 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-49f4cdc6-8a26-496c-9380-e8b0ae69d101 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:08.494088 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-49f4cdc6-8a26-496c-9380-e8b0ae69d101 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:08.503524 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-49f4cdc6-8a26-496c-9380-e8b0ae69d101 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1267 microversion: 2.1 time: 0.166981 Apr 11 14:02:08.504551 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 401/806] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:08 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:08.773369 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d309f653-995b-4256-9a11-67f973eab221 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:08.774245 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d309f653-995b-4256-9a11-67f973eab221 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:08.782092 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d309f653-995b-4256-9a11-67f973eab221 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:08.782815 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d309f653-995b-4256-9a11-67f973eab221 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:08.783693 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d309f653-995b-4256-9a11-67f973eab221 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:08.784168 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d309f653-995b-4256-9a11-67f973eab221 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:09.041012 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d309f653-995b-4256-9a11-67f973eab221 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:09.048773 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d309f653-995b-4256-9a11-67f973eab221 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1575 microversion: 2.1 time: 0.282258 Apr 11 14:02:09.049458 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 406/807] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:08 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1575 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:09.339518 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-85eb9270-7701-4f2c-950d-2aefc060cb25 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:09.340434 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-85eb9270-7701-4f2c-950d-2aefc060cb25 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:09.348820 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-85eb9270-7701-4f2c-950d-2aefc060cb25 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:09.349357 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-85eb9270-7701-4f2c-950d-2aefc060cb25 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:09.350868 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-85eb9270-7701-4f2c-950d-2aefc060cb25 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:09.351393 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-85eb9270-7701-4f2c-950d-2aefc060cb25 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:09.511824 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-85eb9270-7701-4f2c-950d-2aefc060cb25 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:09.519527 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-85eb9270-7701-4f2c-950d-2aefc060cb25 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 200 len: 1366 microversion: 2.1 time: 0.184395 Apr 11 14:02:09.520273 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 402/808] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:09 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:09.520457 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f1978736-de47-4a28-b8b8-4b9b6d699ff3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:09.526301 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f1978736-de47-4a28-b8b8-4b9b6d699ff3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:09.534624 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1978736-de47-4a28-b8b8-4b9b6d699ff3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:09.535168 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1978736-de47-4a28-b8b8-4b9b6d699ff3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:09.536160 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1978736-de47-4a28-b8b8-4b9b6d699ff3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:09.536671 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1978736-de47-4a28-b8b8-4b9b6d699ff3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:09.646679 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-946c978f-fc71-4eb1-8773-e88d381f1236 req-82652660-9101-4217-b417-d21af1ac257d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b16e2e-daa2-4b92-a76a-1616af70478a", "tag": "a40b3497-1c52-41d9-96c8-2f72a240605d"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:09.676597 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-946c978f-fc71-4eb1-8773-e88d381f1236 req-82652660-9101-4217-b417-d21af1ac257d service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:09.677838 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-946c978f-fc71-4eb1-8773-e88d381f1236 req-82652660-9101-4217-b417-d21af1ac257d service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:09.694505 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-946c978f-fc71-4eb1-8773-e88d381f1236 req-82652660-9101-4217-b417-d21af1ac257d service nova] Creating event network-changed:a40b3497-1c52-41d9-96c8-2f72a240605d for instance 14b16e2e-daa2-4b92-a76a-1616af70478a on hv-cinder-83078 Apr 11 14:02:09.708880 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-946c978f-fc71-4eb1-8773-e88d381f1236 req-82652660-9101-4217-b417-d21af1ac257d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070235 Apr 11 14:02:09.716150 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 403/809] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:09.763827 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f1978736-de47-4a28-b8b8-4b9b6d699ff3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:09.771955 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f1978736-de47-4a28-b8b8-4b9b6d699ff3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1267 microversion: 2.1 time: 0.255442 Apr 11 14:02:09.772548 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 407/810] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:09 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:02:10.066556 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2e9b8da6-1373-4bb1-9ccf-0cc9add80d16 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:10.067170 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2e9b8da6-1373-4bb1-9ccf-0cc9add80d16 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:10.073265 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e9b8da6-1373-4bb1-9ccf-0cc9add80d16 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:10.073949 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e9b8da6-1373-4bb1-9ccf-0cc9add80d16 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:10.074719 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e9b8da6-1373-4bb1-9ccf-0cc9add80d16 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:10.075153 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e9b8da6-1373-4bb1-9ccf-0cc9add80d16 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:10.135336 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-46836126-c058-4483-8895-d3e826860494 req-6c3e48bd-b0a7-41b6-81e4-eb12d15c0e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a988bf-9fbe-4371-a34f-2437494ec1ee", "name": "network-vif-plugged", "status": "completed", "tag": "2f18b7d6-84d7-4249-8b95-51fdbd414e68"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:10.144747 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-46836126-c058-4483-8895-d3e826860494 req-6c3e48bd-b0a7-41b6-81e4-eb12d15c0e10 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:10.145195 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-46836126-c058-4483-8895-d3e826860494 req-6c3e48bd-b0a7-41b6-81e4-eb12d15c0e10 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:10.157765 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-46836126-c058-4483-8895-d3e826860494 req-6c3e48bd-b0a7-41b6-81e4-eb12d15c0e10 service nova] Creating event network-vif-plugged:2f18b7d6-84d7-4249-8b95-51fdbd414e68 for instance e2a988bf-9fbe-4371-a34f-2437494ec1ee on hv-cinder-83078 Apr 11 14:02:10.163789 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-46836126-c058-4483-8895-d3e826860494 req-6c3e48bd-b0a7-41b6-81e4-eb12d15c0e10 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032469 Apr 11 14:02:10.164821 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 408/811] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:02:10.213897 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2e9b8da6-1373-4bb1-9ccf-0cc9add80d16 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:10.221476 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2e9b8da6-1373-4bb1-9ccf-0cc9add80d16 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1575 microversion: 2.1 time: 0.159198 Apr 11 14:02:10.222045 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 404/812] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:10 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:10.538342 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f1fa3c6b-2842-4a69-8717-3d95d7971cd6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:10.539115 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f1fa3c6b-2842-4a69-8717-3d95d7971cd6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:10.545289 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1fa3c6b-2842-4a69-8717-3d95d7971cd6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:10.545741 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1fa3c6b-2842-4a69-8717-3d95d7971cd6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:10.546511 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1fa3c6b-2842-4a69-8717-3d95d7971cd6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:10.546950 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1fa3c6b-2842-4a69-8717-3d95d7971cd6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:10.672784 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f1fa3c6b-2842-4a69-8717-3d95d7971cd6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:10.679919 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f1fa3c6b-2842-4a69-8717-3d95d7971cd6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 200 len: 1366 microversion: 2.1 time: 0.146437 Apr 11 14:02:10.680483 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 409/813] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:10 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:10.789436 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6c8fe865-d5d9-4e29-9f7e-cc276a3d9ac5 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:10.790092 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6c8fe865-d5d9-4e29-9f7e-cc276a3d9ac5 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:10.796366 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6c8fe865-d5d9-4e29-9f7e-cc276a3d9ac5 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:10.796826 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6c8fe865-d5d9-4e29-9f7e-cc276a3d9ac5 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:10.797599 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6c8fe865-d5d9-4e29-9f7e-cc276a3d9ac5 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:10.798040 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6c8fe865-d5d9-4e29-9f7e-cc276a3d9ac5 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:10.930567 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6c8fe865-d5d9-4e29-9f7e-cc276a3d9ac5 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:10.937949 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6c8fe865-d5d9-4e29-9f7e-cc276a3d9ac5 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1267 microversion: 2.1 time: 0.152999 Apr 11 14:02:10.938515 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 405/814] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:10 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:11.238280 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-662ed4e1-c05a-4ee0-9ddf-1b39a91d7db7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:11.238897 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-662ed4e1-c05a-4ee0-9ddf-1b39a91d7db7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:11.245621 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-662ed4e1-c05a-4ee0-9ddf-1b39a91d7db7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:11.246070 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-662ed4e1-c05a-4ee0-9ddf-1b39a91d7db7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:11.246874 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-662ed4e1-c05a-4ee0-9ddf-1b39a91d7db7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:11.247311 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-662ed4e1-c05a-4ee0-9ddf-1b39a91d7db7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:11.385132 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-662ed4e1-c05a-4ee0-9ddf-1b39a91d7db7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:11.392361 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-662ed4e1-c05a-4ee0-9ddf-1b39a91d7db7 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1575 microversion: 2.1 time: 0.157961 Apr 11 14:02:11.392937 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 410/815] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:11 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:11.697778 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1cf08da6-eaaf-47b6-ae2b-f97da76b6d70 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:11.698402 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1cf08da6-eaaf-47b6-ae2b-f97da76b6d70 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:11.704281 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1cf08da6-eaaf-47b6-ae2b-f97da76b6d70 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:11.704729 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1cf08da6-eaaf-47b6-ae2b-f97da76b6d70 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:11.705502 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1cf08da6-eaaf-47b6-ae2b-f97da76b6d70 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:11.705940 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1cf08da6-eaaf-47b6-ae2b-f97da76b6d70 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:11.831596 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1cf08da6-eaaf-47b6-ae2b-f97da76b6d70 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:11.839535 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1cf08da6-eaaf-47b6-ae2b-f97da76b6d70 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 200 len: 1366 microversion: 2.1 time: 0.145739 Apr 11 14:02:11.840145 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 406/816] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:11 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:11.955188 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5bfd04e8-f851-440b-b979-7a334dcd9853 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:11.955855 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5bfd04e8-f851-440b-b979-7a334dcd9853 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:11.962736 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5bfd04e8-f851-440b-b979-7a334dcd9853 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:11.963192 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5bfd04e8-f851-440b-b979-7a334dcd9853 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:11.964072 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5bfd04e8-f851-440b-b979-7a334dcd9853 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:11.964520 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5bfd04e8-f851-440b-b979-7a334dcd9853 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:12.112568 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5bfd04e8-f851-440b-b979-7a334dcd9853 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:12.120156 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5bfd04e8-f851-440b-b979-7a334dcd9853 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1267 microversion: 2.1 time: 0.168807 Apr 11 14:02:12.120777 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 411/817] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:11 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:12.409795 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-90e8a650-8548-4c2d-b752-387b1be6ce2a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:12.410424 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-90e8a650-8548-4c2d-b752-387b1be6ce2a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:12.416778 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-90e8a650-8548-4c2d-b752-387b1be6ce2a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:12.417233 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-90e8a650-8548-4c2d-b752-387b1be6ce2a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:12.418182 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-90e8a650-8548-4c2d-b752-387b1be6ce2a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:12.418618 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-90e8a650-8548-4c2d-b752-387b1be6ce2a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:12.557853 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-90e8a650-8548-4c2d-b752-387b1be6ce2a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:12.565363 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-90e8a650-8548-4c2d-b752-387b1be6ce2a tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1562 microversion: 2.1 time: 0.159593 Apr 11 14:02:12.565952 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 407/818] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:12 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:12.856806 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6ab4b2aa-2c52-42a8-833b-7e46bb098d33 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:12.857427 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6ab4b2aa-2c52-42a8-833b-7e46bb098d33 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:12.863204 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ab4b2aa-2c52-42a8-833b-7e46bb098d33 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:12.863683 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ab4b2aa-2c52-42a8-833b-7e46bb098d33 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:12.864696 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ab4b2aa-2c52-42a8-833b-7e46bb098d33 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:12.865133 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ab4b2aa-2c52-42a8-833b-7e46bb098d33 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:13.064115 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6ab4b2aa-2c52-42a8-833b-7e46bb098d33 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:13.072074 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6ab4b2aa-2c52-42a8-833b-7e46bb098d33 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 200 len: 1366 microversion: 2.1 time: 0.219065 Apr 11 14:02:13.072673 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 412/819] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:12 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:13.136421 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f1f16e0e-4ebd-4c5d-b854-7d4daba51d47 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:13.137038 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f1f16e0e-4ebd-4c5d-b854-7d4daba51d47 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:13.143244 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1f16e0e-4ebd-4c5d-b854-7d4daba51d47 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:13.143724 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1f16e0e-4ebd-4c5d-b854-7d4daba51d47 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:13.144484 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1f16e0e-4ebd-4c5d-b854-7d4daba51d47 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:13.144917 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1f16e0e-4ebd-4c5d-b854-7d4daba51d47 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:13.273068 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f1f16e0e-4ebd-4c5d-b854-7d4daba51d47 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:13.280521 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f1f16e0e-4ebd-4c5d-b854-7d4daba51d47 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1267 microversion: 2.1 time: 0.147895 Apr 11 14:02:13.281086 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 408/820] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:13 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:13.992246 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5515f7f1-3f9b-4914-a38b-c64a03518753 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:13.993260 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5515f7f1-3f9b-4914-a38b-c64a03518753 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:13.999555 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5515f7f1-3f9b-4914-a38b-c64a03518753 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:14.000031 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5515f7f1-3f9b-4914-a38b-c64a03518753 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:14.000791 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5515f7f1-3f9b-4914-a38b-c64a03518753 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:14.001227 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5515f7f1-3f9b-4914-a38b-c64a03518753 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:14.030758 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5515f7f1-3f9b-4914-a38b-c64a03518753 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042346 Apr 11 14:02:14.031508 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 413/821] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:02:13 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:14.042214 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2e0ee1cc-a72f-4e6e-ba10-82f82ee00b0d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:14.042711 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2e0ee1cc-a72f-4e6e-ba10-82f82ee00b0d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:14.050702 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e0ee1cc-a72f-4e6e-ba10-82f82ee00b0d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:14.051663 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e0ee1cc-a72f-4e6e-ba10-82f82ee00b0d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:14.052439 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e0ee1cc-a72f-4e6e-ba10-82f82ee00b0d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:14.052880 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e0ee1cc-a72f-4e6e-ba10-82f82ee00b0d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:14.081655 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2e0ee1cc-a72f-4e6e-ba10-82f82ee00b0d tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments/dcbddcf3-f162-4f81-96a7-c741cad5764b" status: 200 len: 194 microversion: 2.1 time: 0.043461 Apr 11 14:02:14.082423 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 409/822] 10.222.0.67 () {58 vars in 1412 bytes} [Mon Apr 11 14:02:14 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments/dcbddcf3-f162-4f81-96a7-c741cad5764b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:02:14.089257 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ddedbe94-f61c-4782-8605-79ebe6ed7cfe tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:14.090013 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ddedbe94-f61c-4782-8605-79ebe6ed7cfe tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:14.096278 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ddedbe94-f61c-4782-8605-79ebe6ed7cfe tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:14.096790 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ddedbe94-f61c-4782-8605-79ebe6ed7cfe tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:14.097627 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ddedbe94-f61c-4782-8605-79ebe6ed7cfe tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:14.098368 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ddedbe94-f61c-4782-8605-79ebe6ed7cfe tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:14.238117 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ddedbe94-f61c-4782-8605-79ebe6ed7cfe tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:14.246600 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ddedbe94-f61c-4782-8605-79ebe6ed7cfe tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 200 len: 1366 microversion: 2.1 time: 0.161411 Apr 11 14:02:14.247178 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 414/823] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:14 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:14.274809 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-68d915fc-3c21-4dbb-85ac-9bfe4ecc38e9 req-a5c7c45b-66a0-4f6f-a606-87746e1d90e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b16e2e-daa2-4b92-a76a-1616af70478a", "name": "network-vif-plugged", "status": "completed", "tag": "a40b3497-1c52-41d9-96c8-2f72a240605d"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:14.284372 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-68d915fc-3c21-4dbb-85ac-9bfe4ecc38e9 req-a5c7c45b-66a0-4f6f-a606-87746e1d90e2 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:14.285138 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-68d915fc-3c21-4dbb-85ac-9bfe4ecc38e9 req-a5c7c45b-66a0-4f6f-a606-87746e1d90e2 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:14.297383 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dc4fa361-3046-47c8-a1f4-df0d0fce18cc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:14.298006 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dc4fa361-3046-47c8-a1f4-df0d0fce18cc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:14.307290 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-68d915fc-3c21-4dbb-85ac-9bfe4ecc38e9 req-a5c7c45b-66a0-4f6f-a606-87746e1d90e2 service nova] Creating event network-vif-plugged:a40b3497-1c52-41d9-96c8-2f72a240605d for instance 14b16e2e-daa2-4b92-a76a-1616af70478a on hv-cinder-83078 Apr 11 14:02:14.312746 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-68d915fc-3c21-4dbb-85ac-9bfe4ecc38e9 req-a5c7c45b-66a0-4f6f-a606-87746e1d90e2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041971 Apr 11 14:02:14.313894 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc4fa361-3046-47c8-a1f4-df0d0fce18cc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:14.314460 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc4fa361-3046-47c8-a1f4-df0d0fce18cc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:14.314873 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 410/824] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:14.315618 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc4fa361-3046-47c8-a1f4-df0d0fce18cc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:14.316302 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc4fa361-3046-47c8-a1f4-df0d0fce18cc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:14.513395 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dc4fa361-3046-47c8-a1f4-df0d0fce18cc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:14.521795 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dc4fa361-3046-47c8-a1f4-df0d0fce18cc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1267 microversion: 2.1 time: 0.228406 Apr 11 14:02:14.522371 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 415/825] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:14 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:15.263542 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-714ad2e5-3bc6-4296-903d-4fd89ae52d8c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:15.264284 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-714ad2e5-3bc6-4296-903d-4fd89ae52d8c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:15.270989 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-714ad2e5-3bc6-4296-903d-4fd89ae52d8c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:15.271467 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-714ad2e5-3bc6-4296-903d-4fd89ae52d8c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:15.272259 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-714ad2e5-3bc6-4296-903d-4fd89ae52d8c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:15.272695 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-714ad2e5-3bc6-4296-903d-4fd89ae52d8c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:15.402336 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-714ad2e5-3bc6-4296-903d-4fd89ae52d8c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:15.409595 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-714ad2e5-3bc6-4296-903d-4fd89ae52d8c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 200 len: 1366 microversion: 2.1 time: 0.150362 Apr 11 14:02:15.410158 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 411/826] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:15 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:15.470006 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-95c096dd-90e0-4c4f-982e-a2a95fc8fd5c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d144b669-2c6c-4146-a8e5-78614eb5dcd4"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:15.471105 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-95c096dd-90e0-4c4f-982e-a2a95fc8fd5c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:15.478010 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-95c096dd-90e0-4c4f-982e-a2a95fc8fd5c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:15.478514 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-95c096dd-90e0-4c4f-982e-a2a95fc8fd5c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:15.479291 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-95c096dd-90e0-4c4f-982e-a2a95fc8fd5c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:15.479755 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-95c096dd-90e0-4c4f-982e-a2a95fc8fd5c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:15.539145 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7ba55755-8cb7-4a11-acfc-7ac8d73b3e02 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:15.539880 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7ba55755-8cb7-4a11-acfc-7ac8d73b3e02 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:15.546108 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ba55755-8cb7-4a11-acfc-7ac8d73b3e02 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:15.546631 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ba55755-8cb7-4a11-acfc-7ac8d73b3e02 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:15.547466 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ba55755-8cb7-4a11-acfc-7ac8d73b3e02 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:15.548017 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ba55755-8cb7-4a11-acfc-7ac8d73b3e02 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:15.687860 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7ba55755-8cb7-4a11-acfc-7ac8d73b3e02 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:15.695284 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7ba55755-8cb7-4a11-acfc-7ac8d73b3e02 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1267 microversion: 2.1 time: 0.160533 Apr 11 14:02:15.695905 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 412/827] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:15 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:02:15.735158 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-95c096dd-90e0-4c4f-982e-a2a95fc8fd5c tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "POST /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269028 Apr 11 14:02:15.735791 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 416/828] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 14:02:15 2022] POST /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:16.365225 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-ec5f85e7-8923-4375-9e64-a416e1c0e448 req-eb104b13-d760-46af-ad5f-66415e6038bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3758fe41-ad1e-4bbb-a152-9cc831519aca", "name": "network-vif-plugged", "status": "completed", "tag": "64a97990-f586-4554-ba0f-e0bf82738eaf"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:16.373697 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-ec5f85e7-8923-4375-9e64-a416e1c0e448 req-eb104b13-d760-46af-ad5f-66415e6038bf service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:16.374150 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-ec5f85e7-8923-4375-9e64-a416e1c0e448 req-eb104b13-d760-46af-ad5f-66415e6038bf service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:16.385716 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-ec5f85e7-8923-4375-9e64-a416e1c0e448 req-eb104b13-d760-46af-ad5f-66415e6038bf service nova] Creating event network-vif-plugged:64a97990-f586-4554-ba0f-e0bf82738eaf for instance 3758fe41-ad1e-4bbb-a152-9cc831519aca on hv-cinder-83078 Apr 11 14:02:16.390496 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-ec5f85e7-8923-4375-9e64-a416e1c0e448 req-eb104b13-d760-46af-ad5f-66415e6038bf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029521 Apr 11 14:02:16.391088 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 413/829] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:16.428644 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a5c297f5-7ab6-4911-87c1-e51295ee1d11 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:16.429336 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a5c297f5-7ab6-4911-87c1-e51295ee1d11 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:16.435408 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5c297f5-7ab6-4911-87c1-e51295ee1d11 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:16.436005 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5c297f5-7ab6-4911-87c1-e51295ee1d11 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:16.436757 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5c297f5-7ab6-4911-87c1-e51295ee1d11 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:16.437185 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5c297f5-7ab6-4911-87c1-e51295ee1d11 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:16.582517 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a5c297f5-7ab6-4911-87c1-e51295ee1d11 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:16.590107 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a5c297f5-7ab6-4911-87c1-e51295ee1d11 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 200 len: 1556 microversion: 2.1 time: 0.166763 Apr 11 14:02:16.590735 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 417/830] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:16 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:16.608977 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b1ea80fe-2beb-4a35-8190-82d72191ab71 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:16.609567 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b1ea80fe-2beb-4a35-8190-82d72191ab71 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:16.617885 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1ea80fe-2beb-4a35-8190-82d72191ab71 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:16.618573 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1ea80fe-2beb-4a35-8190-82d72191ab71 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:16.619360 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1ea80fe-2beb-4a35-8190-82d72191ab71 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:16.619845 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1ea80fe-2beb-4a35-8190-82d72191ab71 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:16.697721 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b1ea80fe-2beb-4a35-8190-82d72191ab71 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094303 Apr 11 14:02:16.698314 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 414/831] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Apr 11 14:02:16 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:16.711235 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f384f488-3147-46fe-af90-8f9346eb1b7e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:16.711927 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f384f488-3147-46fe-af90-8f9346eb1b7e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:16.718002 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f384f488-3147-46fe-af90-8f9346eb1b7e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:16.718453 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f384f488-3147-46fe-af90-8f9346eb1b7e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:16.719231 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f384f488-3147-46fe-af90-8f9346eb1b7e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:16.719685 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f384f488-3147-46fe-af90-8f9346eb1b7e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:16.855167 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f384f488-3147-46fe-af90-8f9346eb1b7e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:16.862690 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f384f488-3147-46fe-af90-8f9346eb1b7e tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1267 microversion: 2.1 time: 0.155623 Apr 11 14:02:16.863233 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 418/832] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:16 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:17.881027 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d2552b40-b6cb-45b4-bf6f-3afad72f0ed0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:17.882591 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d2552b40-b6cb-45b4-bf6f-3afad72f0ed0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:17.891191 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-f75beb33-13a2-441d-89ec-601e200dd359 req-0cc73cf1-1249-4dc9-94d4-b0f40ceb01b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b16e2e-daa2-4b92-a76a-1616af70478a", "tag": "a40b3497-1c52-41d9-96c8-2f72a240605d"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:17.892215 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2552b40-b6cb-45b4-bf6f-3afad72f0ed0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:17.892891 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2552b40-b6cb-45b4-bf6f-3afad72f0ed0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:17.893902 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2552b40-b6cb-45b4-bf6f-3afad72f0ed0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:17.895309 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2552b40-b6cb-45b4-bf6f-3afad72f0ed0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:17.900886 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-f75beb33-13a2-441d-89ec-601e200dd359 req-0cc73cf1-1249-4dc9-94d4-b0f40ceb01b5 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:17.901283 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-f75beb33-13a2-441d-89ec-601e200dd359 req-0cc73cf1-1249-4dc9-94d4-b0f40ceb01b5 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:17.914848 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-f75beb33-13a2-441d-89ec-601e200dd359 req-0cc73cf1-1249-4dc9-94d4-b0f40ceb01b5 service nova] Creating event network-changed:a40b3497-1c52-41d9-96c8-2f72a240605d for instance 14b16e2e-daa2-4b92-a76a-1616af70478a on hv-cinder-83078 Apr 11 14:02:17.919868 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-f75beb33-13a2-441d-89ec-601e200dd359 req-0cc73cf1-1249-4dc9-94d4-b0f40ceb01b5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032124 Apr 11 14:02:17.921916 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 419/833] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:02:18.032275 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d2552b40-b6cb-45b4-bf6f-3afad72f0ed0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:18.040257 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d2552b40-b6cb-45b4-bf6f-3afad72f0ed0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1267 microversion: 2.1 time: 0.164961 Apr 11 14:02:18.040827 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 415/834] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:17 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:19.058022 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-68e330a8-9b22-43ce-811f-6d1dc2d444c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:19.058664 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-68e330a8-9b22-43ce-811f-6d1dc2d444c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:19.064782 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-68e330a8-9b22-43ce-811f-6d1dc2d444c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:19.065234 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-68e330a8-9b22-43ce-811f-6d1dc2d444c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:19.066002 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-68e330a8-9b22-43ce-811f-6d1dc2d444c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:19.066927 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-68e330a8-9b22-43ce-811f-6d1dc2d444c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:19.198958 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-68e330a8-9b22-43ce-811f-6d1dc2d444c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:19.206693 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-68e330a8-9b22-43ce-811f-6d1dc2d444c1 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1454 microversion: 2.1 time: 0.153430 Apr 11 14:02:19.207314 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 420/835] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:19 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:19.222479 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9582366b-bb23-4859-b6be-04331926e828 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:19.223275 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9582366b-bb23-4859-b6be-04331926e828 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:19.229538 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9582366b-bb23-4859-b6be-04331926e828 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:19.229997 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9582366b-bb23-4859-b6be-04331926e828 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:19.230767 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9582366b-bb23-4859-b6be-04331926e828 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:19.231211 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9582366b-bb23-4859-b6be-04331926e828 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:19.358077 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9582366b-bb23-4859-b6be-04331926e828 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:19.365994 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9582366b-bb23-4859-b6be-04331926e828 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1454 microversion: 2.1 time: 0.147297 Apr 11 14:02:19.366568 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 416/836] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:19 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:21.016378 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-3b27b6a9-6bdb-4ce0-8d35-10e217350883 req-820520da-5c55-4b64-9df8-85b1f984688d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3758fe41-ad1e-4bbb-a152-9cc831519aca", "tag": "64a97990-f586-4554-ba0f-e0bf82738eaf"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:21.026495 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-3b27b6a9-6bdb-4ce0-8d35-10e217350883 req-820520da-5c55-4b64-9df8-85b1f984688d service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:21.026934 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-3b27b6a9-6bdb-4ce0-8d35-10e217350883 req-820520da-5c55-4b64-9df8-85b1f984688d service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:21.038137 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-3b27b6a9-6bdb-4ce0-8d35-10e217350883 req-820520da-5c55-4b64-9df8-85b1f984688d service nova] Creating event network-changed:64a97990-f586-4554-ba0f-e0bf82738eaf for instance 3758fe41-ad1e-4bbb-a152-9cc831519aca on hv-cinder-83078 Apr 11 14:02:21.043259 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-3b27b6a9-6bdb-4ce0-8d35-10e217350883 req-820520da-5c55-4b64-9df8-85b1f984688d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030550 Apr 11 14:02:21.043951 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 421/837] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:24.286313 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ed88db37-5b2c-45b5-af9c-9484d9dab291 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:24.287293 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ed88db37-5b2c-45b5-af9c-9484d9dab291 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:24.293625 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed88db37-5b2c-45b5-af9c-9484d9dab291 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:24.294083 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed88db37-5b2c-45b5-af9c-9484d9dab291 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:24.294845 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed88db37-5b2c-45b5-af9c-9484d9dab291 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:24.295279 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed88db37-5b2c-45b5-af9c-9484d9dab291 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:24.323463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ed88db37-5b2c-45b5-af9c-9484d9dab291 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041716 Apr 11 14:02:24.324071 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 417/838] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:02:24 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:02:24.475717 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3790372b-e50d-407e-9d42-7864e5f34dff tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:24.476278 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3790372b-e50d-407e-9d42-7864e5f34dff tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:24.482359 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3790372b-e50d-407e-9d42-7864e5f34dff tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:24.482810 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3790372b-e50d-407e-9d42-7864e5f34dff tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:24.483575 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3790372b-e50d-407e-9d42-7864e5f34dff tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:24.484034 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3790372b-e50d-407e-9d42-7864e5f34dff tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:24.511458 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3790372b-e50d-407e-9d42-7864e5f34dff tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments/dcbddcf3-f162-4f81-96a7-c741cad5764b" status: 200 len: 194 microversion: 2.1 time: 0.041549 Apr 11 14:02:24.512069 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 422/839] 10.222.0.67 () {58 vars in 1412 bytes} [Mon Apr 11 14:02:24 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments/dcbddcf3-f162-4f81-96a7-c741cad5764b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:24.522134 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0915619a-2d0f-4a31-a139-205d25dd70c2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:24.522638 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0915619a-2d0f-4a31-a139-205d25dd70c2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:24.528837 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0915619a-2d0f-4a31-a139-205d25dd70c2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:24.529300 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0915619a-2d0f-4a31-a139-205d25dd70c2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:24.530075 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0915619a-2d0f-4a31-a139-205d25dd70c2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:24.530520 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0915619a-2d0f-4a31-a139-205d25dd70c2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:24.607033 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-0915619a-2d0f-4a31-a139-205d25dd70c2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lazy-loading 'services' on Instance uuid c2990320-e015-4b65-9175-4b875d4142fd {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:02:24.675242 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0915619a-2d0f-4a31-a139-205d25dd70c2 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments/dcbddcf3-f162-4f81-96a7-c741cad5764b" status: 202 len: 0 microversion: 2.1 time: 0.157379 Apr 11 14:02:24.675905 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 418/840] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Apr 11 14:02:24 2022] DELETE /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments/dcbddcf3-f162-4f81-96a7-c741cad5764b => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:02:26.834593 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c8b48417-1c7a-4478-805c-4ec882883e03 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:26.835122 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c8b48417-1c7a-4478-805c-4ec882883e03 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:26.841393 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c8b48417-1c7a-4478-805c-4ec882883e03 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:26.841839 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c8b48417-1c7a-4478-805c-4ec882883e03 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:26.842595 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c8b48417-1c7a-4478-805c-4ec882883e03 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:26.843023 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c8b48417-1c7a-4478-805c-4ec882883e03 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:26.872076 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c8b48417-1c7a-4478-805c-4ec882883e03 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments/d144b669-2c6c-4146-a8e5-78614eb5dcd4" status: 200 len: 194 microversion: 2.1 time: 0.041473 Apr 11 14:02:26.872651 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 423/841] 10.222.0.67 () {58 vars in 1412 bytes} [Mon Apr 11 14:02:26 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments/d144b669-2c6c-4146-a8e5-78614eb5dcd4 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:26.883738 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5783013a-2083-4336-9ff7-ca82a77b53ba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:26.884343 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5783013a-2083-4336-9ff7-ca82a77b53ba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:26.890310 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5783013a-2083-4336-9ff7-ca82a77b53ba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:26.890761 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5783013a-2083-4336-9ff7-ca82a77b53ba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:26.891533 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5783013a-2083-4336-9ff7-ca82a77b53ba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:26.891982 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5783013a-2083-4336-9ff7-ca82a77b53ba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:26.967194 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-5783013a-2083-4336-9ff7-ca82a77b53ba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lazy-loading 'services' on Instance uuid c2990320-e015-4b65-9175-4b875d4142fd {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:02:27.042177 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5783013a-2083-4336-9ff7-ca82a77b53ba tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments/d144b669-2c6c-4146-a8e5-78614eb5dcd4" status: 202 len: 0 microversion: 2.1 time: 0.163470 Apr 11 14:02:27.042708 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 419/842] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Apr 11 14:02:26 2022] DELETE /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments/d144b669-2c6c-4146-a8e5-78614eb5dcd4 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:02:28.198736 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c6f88317-a922-42fb-94db-4eb626c4fc05 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:28.199728 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c6f88317-a922-42fb-94db-4eb626c4fc05 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:28.205960 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c6f88317-a922-42fb-94db-4eb626c4fc05 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:28.206903 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c6f88317-a922-42fb-94db-4eb626c4fc05 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:28.207692 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c6f88317-a922-42fb-94db-4eb626c4fc05 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:28.208131 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c6f88317-a922-42fb-94db-4eb626c4fc05 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:28.235466 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c6f88317-a922-42fb-94db-4eb626c4fc05 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040639 Apr 11 14:02:28.236037 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 424/843] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:02:28 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 14:02:28.339557 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7e2d079b-caf4-4db5-a7eb-8cdb347a8025 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:28.340655 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7e2d079b-caf4-4db5-a7eb-8cdb347a8025 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:28.346586 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e2d079b-caf4-4db5-a7eb-8cdb347a8025 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:28.347106 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e2d079b-caf4-4db5-a7eb-8cdb347a8025 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:28.347883 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e2d079b-caf4-4db5-a7eb-8cdb347a8025 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:28.348317 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e2d079b-caf4-4db5-a7eb-8cdb347a8025 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:28.376527 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7e2d079b-caf4-4db5-a7eb-8cdb347a8025 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041685 Apr 11 14:02:28.377080 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 420/844] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:02:28 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 14:02:28.433042 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-24e39e87-51a0-4364-b080-898b256c26e4 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:28.433546 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-24e39e87-51a0-4364-b080-898b256c26e4 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:28.439340 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-24e39e87-51a0-4364-b080-898b256c26e4 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:28.439832 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-24e39e87-51a0-4364-b080-898b256c26e4 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:28.440685 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-24e39e87-51a0-4364-b080-898b256c26e4 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:28.441907 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-24e39e87-51a0-4364-b080-898b256c26e4 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:28.464989 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-24e39e87-51a0-4364-b080-898b256c26e4 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:02:28.541028 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-24e39e87-51a0-4364-b080-898b256c26e4 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 204 len: 0 microversion: 2.1 time: 0.111426 Apr 11 14:02:28.541548 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 425/845] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:02:28 2022] DELETE /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:02:28.552384 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-36241054-492a-45b9-8ef3-0dc8962a5512 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:28.553486 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-36241054-492a-45b9-8ef3-0dc8962a5512 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:28.559152 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-36241054-492a-45b9-8ef3-0dc8962a5512 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:28.559598 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-36241054-492a-45b9-8ef3-0dc8962a5512 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:28.560389 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-36241054-492a-45b9-8ef3-0dc8962a5512 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:28.560821 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-36241054-492a-45b9-8ef3-0dc8962a5512 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:28.687938 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-36241054-492a-45b9-8ef3-0dc8962a5512 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:28.695422 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-36241054-492a-45b9-8ef3-0dc8962a5512 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1675 microversion: 2.1 time: 0.149366 Apr 11 14:02:28.696097 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 421/846] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:28 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:29.713422 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-22e3633c-1c27-4672-88ee-cdf976e38b98 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:29.714057 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-22e3633c-1c27-4672-88ee-cdf976e38b98 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:29.720372 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-22e3633c-1c27-4672-88ee-cdf976e38b98 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:29.720826 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-22e3633c-1c27-4672-88ee-cdf976e38b98 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:29.721598 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-22e3633c-1c27-4672-88ee-cdf976e38b98 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:29.722050 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-22e3633c-1c27-4672-88ee-cdf976e38b98 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:29.847417 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-22e3633c-1c27-4672-88ee-cdf976e38b98 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:29.854744 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-22e3633c-1c27-4672-88ee-cdf976e38b98 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1675 microversion: 2.1 time: 0.145640 Apr 11 14:02:29.855324 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 426/847] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:29 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:30.872538 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8ceff07c-42c1-4fc8-8b83-bd471a31f2d6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:30.873146 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8ceff07c-42c1-4fc8-8b83-bd471a31f2d6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:30.880217 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ceff07c-42c1-4fc8-8b83-bd471a31f2d6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:30.880675 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ceff07c-42c1-4fc8-8b83-bd471a31f2d6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:30.881462 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ceff07c-42c1-4fc8-8b83-bd471a31f2d6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:30.882303 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ceff07c-42c1-4fc8-8b83-bd471a31f2d6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:31.014211 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8ceff07c-42c1-4fc8-8b83-bd471a31f2d6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bcde529b708471eb9c1b74e15b588b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8720d1d0e26443d96a5f29175402af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:31.022554 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8ceff07c-42c1-4fc8-8b83-bd471a31f2d6 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 200 len: 1675 microversion: 2.1 time: 0.153635 Apr 11 14:02:31.023138 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 422/848] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:30 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:31.498838 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-b6c3b610-4871-4b15-b3d5-14cd9a5d9ea3 req-4eafedf5-6d84-4ddd-add7-21e0e3aa9b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2990320-e015-4b65-9175-4b875d4142fd", "name": "network-vif-deleted", "tag": "26a6c2cb-0c2f-44e9-812a-19d9f51501fe"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:31.510807 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-b6c3b610-4871-4b15-b3d5-14cd9a5d9ea3 req-4eafedf5-6d84-4ddd-add7-21e0e3aa9b6f service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:31.511583 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-b6c3b610-4871-4b15-b3d5-14cd9a5d9ea3 req-4eafedf5-6d84-4ddd-add7-21e0e3aa9b6f service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:31.525697 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-b6c3b610-4871-4b15-b3d5-14cd9a5d9ea3 req-4eafedf5-6d84-4ddd-add7-21e0e3aa9b6f service nova] Creating event network-vif-deleted:26a6c2cb-0c2f-44e9-812a-19d9f51501fe for instance c2990320-e015-4b65-9175-4b875d4142fd on hv-cinder-83078 Apr 11 14:02:31.530714 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-b6c3b610-4871-4b15-b3d5-14cd9a5d9ea3 req-4eafedf5-6d84-4ddd-add7-21e0e3aa9b6f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035898 Apr 11 14:02:31.532049 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 427/849] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:32.041675 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-44ff2efd-0464-488a-9d4e-e87851b3d568 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:32.042241 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-44ff2efd-0464-488a-9d4e-e87851b3d568 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:32.048269 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-44ff2efd-0464-488a-9d4e-e87851b3d568 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:32.048970 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-44ff2efd-0464-488a-9d4e-e87851b3d568 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:32.050606 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-44ff2efd-0464-488a-9d4e-e87851b3d568 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:32.051330 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-44ff2efd-0464-488a-9d4e-e87851b3d568 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:32.066918 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-44ff2efd-0464-488a-9d4e-e87851b3d568 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] HTTP exception thrown: Instance c2990320-e015-4b65-9175-4b875d4142fd could not be found. Apr 11 14:02:32.067521 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-44ff2efd-0464-488a-9d4e-e87851b3d568 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Returning 404 to user: Instance c2990320-e015-4b65-9175-4b875d4142fd could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:02:32.068407 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-44ff2efd-0464-488a-9d4e-e87851b3d568 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 404 len: 111 microversion: 2.1 time: 0.032219 Apr 11 14:02:32.068964 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 423/850] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:32 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:02:32.077843 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3d945964-32c2-4919-9db2-2639d8ae5da4 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '.version_select at 0x7f730badc670>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:32.095489 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3d945964-32c2-4919-9db2-2639d8ae5da4 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2028920529" status: 202 len: 0 microversion: 2.1 time: 0.021701 Apr 11 14:02:32.096181 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 428/851] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Apr 11 14:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2028920529 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 14:02:34.962293 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5af2132f-83cf-4b28-a0cc-63136c281ae5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:34.962805 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5af2132f-83cf-4b28-a0cc-63136c281ae5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:34.969140 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5af2132f-83cf-4b28-a0cc-63136c281ae5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:34.969599 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5af2132f-83cf-4b28-a0cc-63136c281ae5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:34.970376 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5af2132f-83cf-4b28-a0cc-63136c281ae5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:34.970823 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5af2132f-83cf-4b28-a0cc-63136c281ae5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:34.983753 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-5af2132f-83cf-4b28-a0cc-63136c281ae5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] HTTP exception thrown: Instance c2990320-e015-4b65-9175-4b875d4142fd could not be found. Apr 11 14:02:34.984342 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5af2132f-83cf-4b28-a0cc-63136c281ae5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Returning 404 to user: Instance c2990320-e015-4b65-9175-4b875d4142fd could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:02:34.985174 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5af2132f-83cf-4b28-a0cc-63136c281ae5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 404 len: 111 microversion: 2.1 time: 0.026811 Apr 11 14:02:34.985689 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 424/852] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:02:34 2022] DELETE /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:02:34.993929 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-18d0abd2-96ac-4595-ad11-06b27939d9d1 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:34.994665 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-18d0abd2-96ac-4595-ad11-06b27939d9d1 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: c2990320-e015-4b65-9175-4b875d4142fd] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:35.000995 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-18d0abd2-96ac-4595-ad11-06b27939d9d1 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:35.001441 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-18d0abd2-96ac-4595-ad11-06b27939d9d1 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:35.002225 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-18d0abd2-96ac-4595-ad11-06b27939d9d1 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:35.003291 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-18d0abd2-96ac-4595-ad11-06b27939d9d1 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:35.015842 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-18d0abd2-96ac-4595-ad11-06b27939d9d1 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] HTTP exception thrown: Instance c2990320-e015-4b65-9175-4b875d4142fd could not be found. Apr 11 14:02:35.016420 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-18d0abd2-96ac-4595-ad11-06b27939d9d1 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Returning 404 to user: Instance c2990320-e015-4b65-9175-4b875d4142fd could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:02:35.017219 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-18d0abd2-96ac-4595-ad11-06b27939d9d1 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd" status: 404 len: 111 microversion: 2.1 time: 0.027120 Apr 11 14:02:35.017732 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 429/853] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:34 2022] GET /compute/v2.1/servers/c2990320-e015-4b65-9175-4b875d4142fd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:02:36.144096 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-adc468cb-e272-484b-9916-14842272499a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:36.144607 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-adc468cb-e272-484b-9916-14842272499a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:36.151067 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-adc468cb-e272-484b-9916-14842272499a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:36.151522 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-adc468cb-e272-484b-9916-14842272499a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:36.152326 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-adc468cb-e272-484b-9916-14842272499a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:36.152784 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-adc468cb-e272-484b-9916-14842272499a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:36.166261 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-adc468cb-e272-484b-9916-14842272499a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] HTTP exception thrown: Instance 54dcdce4-931a-42d3-b36a-321afffabdc0 could not be found. Apr 11 14:02:36.166984 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-adc468cb-e272-484b-9916-14842272499a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Returning 404 to user: Instance 54dcdce4-931a-42d3-b36a-321afffabdc0 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:02:36.168053 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-adc468cb-e272-484b-9916-14842272499a tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "DELETE /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 404 len: 111 microversion: 2.1 time: 0.027781 Apr 11 14:02:36.168636 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 425/854] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:02:36 2022] DELETE /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:02:36.177167 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ba09b023-0050-42c6-a262-9253c63e26a5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:36.177802 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ba09b023-0050-42c6-a262-9253c63e26a5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] [instance: 54dcdce4-931a-42d3-b36a-321afffabdc0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:36.184179 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba09b023-0050-42c6-a262-9253c63e26a5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:36.184633 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba09b023-0050-42c6-a262-9253c63e26a5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:36.185403 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba09b023-0050-42c6-a262-9253c63e26a5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:36.185844 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba09b023-0050-42c6-a262-9253c63e26a5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:36.198862 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-ba09b023-0050-42c6-a262-9253c63e26a5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] HTTP exception thrown: Instance 54dcdce4-931a-42d3-b36a-321afffabdc0 could not be found. Apr 11 14:02:36.199435 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ba09b023-0050-42c6-a262-9253c63e26a5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] Returning 404 to user: Instance 54dcdce4-931a-42d3-b36a-321afffabdc0 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:02:36.200305 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ba09b023-0050-42c6-a262-9253c63e26a5 tempest-AttachVolumeTestJSON-1115883157 tempest-AttachVolumeTestJSON-1115883157-project] 10.222.0.67 "GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0" status: 404 len: 111 microversion: 2.1 time: 0.027814 Apr 11 14:02:36.200830 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 430/855] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:02:36 2022] GET /compute/v2.1/servers/54dcdce4-931a-42d3-b36a-321afffabdc0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:02:40.746482 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-df08a31b-85e1-441e-b30a-3d0e97ee957e tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] Action: 'create', calling method: .version_select at 0x7f730756e1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1301772884", "metadata": {"Type": "work"}}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:41.017085 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-df08a31b-85e1-441e-b30a-3d0e97ee957e tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.379143 Apr 11 14:02:41.018467 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 426/856] 10.222.0.67 () {60 vars in 1155 bytes} [Mon Apr 11 14:02:40 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 381 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 11 14:02:41.029573 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-49857950-10b5-4926-bbcf-456f8727edc1 tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] Calling method '.version_select at 0x7f730badcb80>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:41.076977 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-49857950-10b5-4926-bbcf-456f8727edc1 tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/53bdfac0-4949-49aa-a040-1b289f9d995f" status: 200 len: 353 microversion: 2.1 time: 0.051234 Apr 11 14:02:41.077667 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 431/857] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 14:02:41 2022] GET /compute/v2.1/os-volumes/53bdfac0-4949-49aa-a040-1b289f9d995f => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:42.090573 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0382e348-b3b1-4741-b140-e658a5f346db tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] Calling method '.version_select at 0x7f730698e160>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:42.136201 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0382e348-b3b1-4741-b140-e658a5f346db tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/53bdfac0-4949-49aa-a040-1b289f9d995f" status: 200 len: 354 microversion: 2.1 time: 0.049807 Apr 11 14:02:42.136773 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 427/858] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 14:02:42 2022] GET /compute/v2.1/os-volumes/53bdfac0-4949-49aa-a040-1b289f9d995f => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:42.148483 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f2bc149d-ea65-4e17-aa11-8ac865dfbda3 tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] Calling method '.version_select at 0x7f7306a2b4c0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:42.197313 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f2bc149d-ea65-4e17-aa11-8ac865dfbda3 tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/53bdfac0-4949-49aa-a040-1b289f9d995f" status: 200 len: 354 microversion: 2.1 time: 0.053266 Apr 11 14:02:42.197886 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 432/859] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 14:02:42 2022] GET /compute/v2.1/os-volumes/53bdfac0-4949-49aa-a040-1b289f9d995f => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:42.213412 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a7c4a480-4c56-4643-bf6e-ec4f04cdcdd3 tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] Calling method '.version_select at 0x7f73069523a0>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:42.270193 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a7c4a480-4c56-4643-bf6e-ec4f04cdcdd3 tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/53bdfac0-4949-49aa-a040-1b289f9d995f" status: 202 len: 0 microversion: 2.1 time: 0.060545 Apr 11 14:02:42.270777 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 428/860] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Apr 11 14:02:42 2022] DELETE /compute/v2.1/os-volumes/53bdfac0-4949-49aa-a040-1b289f9d995f => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:02:42.279050 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-17b2f174-dc63-41ca-b669-f752663fc6d2 tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] Calling method '.version_select at 0x7f730badc4c0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:42.325382 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-17b2f174-dc63-41ca-b669-f752663fc6d2 tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/53bdfac0-4949-49aa-a040-1b289f9d995f" status: 200 len: 353 microversion: 2.1 time: 0.049996 Apr 11 14:02:42.325963 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 433/861] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 14:02:42 2022] GET /compute/v2.1/os-volumes/53bdfac0-4949-49aa-a040-1b289f9d995f => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:43.338920 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6c97dbd2-6448-45c6-9be4-d669d6ed8550 tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] Calling method '.version_select at 0x7f730680d670>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:43.365583 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-6c97dbd2-6448-45c6-9be4-d669d6ed8550 tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] HTTP exception thrown: Volume 53bdfac0-4949-49aa-a040-1b289f9d995f could not be found. Apr 11 14:02:43.366220 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6c97dbd2-6448-45c6-9be4-d669d6ed8550 tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] Returning 404 to user: Volume 53bdfac0-4949-49aa-a040-1b289f9d995f could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:02:43.367054 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6c97dbd2-6448-45c6-9be4-d669d6ed8550 tempest-VolumesGetTestJSON-1517423684 tempest-VolumesGetTestJSON-1517423684-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/53bdfac0-4949-49aa-a040-1b289f9d995f" status: 404 len: 109 microversion: 2.1 time: 0.032497 Apr 11 14:02:43.367598 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 429/862] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 14:02:43 2022] GET /compute/v2.1/os-volumes/53bdfac0-4949-49aa-a040-1b289f9d995f => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:02:44.069815 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d52f6f47-acb3-45db-b189-a786a1199030 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:44.070898 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d52f6f47-acb3-45db-b189-a786a1199030 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:44.077322 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d52f6f47-acb3-45db-b189-a786a1199030 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:44.077780 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d52f6f47-acb3-45db-b189-a786a1199030 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:44.078591 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d52f6f47-acb3-45db-b189-a786a1199030 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:44.079031 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d52f6f47-acb3-45db-b189-a786a1199030 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:44.106138 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d52f6f47-acb3-45db-b189-a786a1199030 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041363 Apr 11 14:02:44.106702 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 434/863] 10.222.0.67 () {60 vars in 1342 bytes} [Mon Apr 11 14:02:44 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:02:44.168285 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-016d3fd3-df8a-4b57-8269-f99b67aa119a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:44.169184 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-016d3fd3-df8a-4b57-8269-f99b67aa119a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:44.176487 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-016d3fd3-df8a-4b57-8269-f99b67aa119a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:44.177098 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-016d3fd3-df8a-4b57-8269-f99b67aa119a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:44.177726 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-016d3fd3-df8a-4b57-8269-f99b67aa119a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:44.178294 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-016d3fd3-df8a-4b57-8269-f99b67aa119a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:44.203134 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-016d3fd3-df8a-4b57-8269-f99b67aa119a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:02:44.281258 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-016d3fd3-df8a-4b57-8269-f99b67aa119a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 204 len: 0 microversion: 2.20 time: 0.117391 Apr 11 14:02:44.282155 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 430/864] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Apr 11 14:02:44 2022] DELETE /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 14:02:44.291652 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-859735c2-8b28-40e9-a961-5a27e60353bd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:44.292587 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-859735c2-8b28-40e9-a961-5a27e60353bd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:44.298847 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-859735c2-8b28-40e9-a961-5a27e60353bd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:44.299314 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-859735c2-8b28-40e9-a961-5a27e60353bd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:44.300415 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-859735c2-8b28-40e9-a961-5a27e60353bd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:44.300880 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-859735c2-8b28-40e9-a961-5a27e60353bd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:44.440053 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-859735c2-8b28-40e9-a961-5a27e60353bd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:44.448680 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-859735c2-8b28-40e9-a961-5a27e60353bd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:44.450186 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-859735c2-8b28-40e9-a961-5a27e60353bd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:44.451357 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-859735c2-8b28-40e9-a961-5a27e60353bd tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.164814 Apr 11 14:02:44.452096 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 435/865] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:02:44 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 14:02:45.470789 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d9a6fdd7-e71d-4390-88ef-263ca83c926c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:45.471667 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d9a6fdd7-e71d-4390-88ef-263ca83c926c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:45.478644 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d9a6fdd7-e71d-4390-88ef-263ca83c926c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:45.479106 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d9a6fdd7-e71d-4390-88ef-263ca83c926c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:45.479958 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d9a6fdd7-e71d-4390-88ef-263ca83c926c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:45.480404 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d9a6fdd7-e71d-4390-88ef-263ca83c926c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:45.611836 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d9a6fdd7-e71d-4390-88ef-263ca83c926c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:45.620459 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d9a6fdd7-e71d-4390-88ef-263ca83c926c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:45.622045 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d9a6fdd7-e71d-4390-88ef-263ca83c926c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:45.623297 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d9a6fdd7-e71d-4390-88ef-263ca83c926c tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1723 microversion: 2.20 time: 0.156690 Apr 11 14:02:45.623885 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 431/866] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:02:45 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:02:46.642361 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-59e1e30b-6424-4f64-a26c-0ac6de568e7a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:46.642977 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-59e1e30b-6424-4f64-a26c-0ac6de568e7a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:46.650399 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-59e1e30b-6424-4f64-a26c-0ac6de568e7a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:46.650887 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-59e1e30b-6424-4f64-a26c-0ac6de568e7a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:46.651855 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-59e1e30b-6424-4f64-a26c-0ac6de568e7a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:46.652433 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-59e1e30b-6424-4f64-a26c-0ac6de568e7a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:46.748574 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-59e1e30b-6424-4f64-a26c-0ac6de568e7a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:46.760742 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-59e1e30b-6424-4f64-a26c-0ac6de568e7a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:46.761879 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-59e1e30b-6424-4f64-a26c-0ac6de568e7a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539174103f414528829d033481b83b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:02:46.763040 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-59e1e30b-6424-4f64-a26c-0ac6de568e7a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 200 len: 1655 microversion: 2.20 time: 0.124555 Apr 11 14:02:46.763923 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 436/867] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:02:46 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 1655 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 14:02:46.882308 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-dcdc1bf7-aae3-401b-9930-198f3367bba1 req-4a58fe4d-49dc-4a63-9c9d-1823a24f0545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf497683-01c3-4106-adb0-36d23d564607", "name": "network-vif-deleted", "tag": "9c6a342b-a134-4ab5-996e-3eab3c406817"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:46.891448 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-dcdc1bf7-aae3-401b-9930-198f3367bba1 req-4a58fe4d-49dc-4a63-9c9d-1823a24f0545 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:46.891948 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-dcdc1bf7-aae3-401b-9930-198f3367bba1 req-4a58fe4d-49dc-4a63-9c9d-1823a24f0545 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:46.915546 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-dcdc1bf7-aae3-401b-9930-198f3367bba1 req-4a58fe4d-49dc-4a63-9c9d-1823a24f0545 service nova] Creating event network-vif-deleted:9c6a342b-a134-4ab5-996e-3eab3c406817 for instance cf497683-01c3-4106-adb0-36d23d564607 on hv-cinder-83078 Apr 11 14:02:46.921013 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-dcdc1bf7-aae3-401b-9930-198f3367bba1 req-4a58fe4d-49dc-4a63-9c9d-1823a24f0545 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042844 Apr 11 14:02:46.924806 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 432/868] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:47.782197 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-104bc798-6383-440b-9d04-4c788afcf22a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:47.782801 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-104bc798-6383-440b-9d04-4c788afcf22a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:47.789879 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-104bc798-6383-440b-9d04-4c788afcf22a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:47.790475 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-104bc798-6383-440b-9d04-4c788afcf22a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:47.791249 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-104bc798-6383-440b-9d04-4c788afcf22a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:47.791707 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-104bc798-6383-440b-9d04-4c788afcf22a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:47.804936 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-104bc798-6383-440b-9d04-4c788afcf22a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] HTTP exception thrown: Instance cf497683-01c3-4106-adb0-36d23d564607 could not be found. Apr 11 14:02:47.805525 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-104bc798-6383-440b-9d04-4c788afcf22a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Returning 404 to user: Instance cf497683-01c3-4106-adb0-36d23d564607 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:02:47.806350 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-104bc798-6383-440b-9d04-4c788afcf22a tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 404 len: 111 microversion: 2.20 time: 0.028095 Apr 11 14:02:47.806905 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 437/869] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:02:47 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 14:02:47.816252 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5b6ec4e7-e573-47f4-b800-882dfb030ef4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '.version_select at 0x7f730693e9d0>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:47.834977 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5b6ec4e7-e573-47f4-b800-882dfb030ef4 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-474357988" status: 204 len: 0 microversion: 2.20 time: 0.023270 Apr 11 14:02:47.835568 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 433/870] 10.222.0.67 () {60 vars in 1258 bytes} [Mon Apr 11 14:02:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-474357988 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 14:02:49.572459 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8489a13d-a953-40be-8c67-ad1bf71c1bdf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:49.572954 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8489a13d-a953-40be-8c67-ad1bf71c1bdf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:49.579124 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8489a13d-a953-40be-8c67-ad1bf71c1bdf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:49.579571 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8489a13d-a953-40be-8c67-ad1bf71c1bdf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:49.580363 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8489a13d-a953-40be-8c67-ad1bf71c1bdf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:49.580790 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8489a13d-a953-40be-8c67-ad1bf71c1bdf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:49.593686 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-8489a13d-a953-40be-8c67-ad1bf71c1bdf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] HTTP exception thrown: Instance cf497683-01c3-4106-adb0-36d23d564607 could not be found. Apr 11 14:02:49.594262 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8489a13d-a953-40be-8c67-ad1bf71c1bdf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Returning 404 to user: Instance cf497683-01c3-4106-adb0-36d23d564607 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:02:49.595157 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8489a13d-a953-40be-8c67-ad1bf71c1bdf tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 404 len: 111 microversion: 2.20 time: 0.026482 Apr 11 14:02:49.595578 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 438/871] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Apr 11 14:02:49 2022] DELETE /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 14:02:49.604705 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-60bf22b7-6587-4cbd-887c-a1e0c827f83b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:49.605448 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-60bf22b7-6587-4cbd-887c-a1e0c827f83b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: cf497683-01c3-4106-adb0-36d23d564607] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:49.611455 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60bf22b7-6587-4cbd-887c-a1e0c827f83b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:49.611950 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60bf22b7-6587-4cbd-887c-a1e0c827f83b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:49.613569 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60bf22b7-6587-4cbd-887c-a1e0c827f83b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:49.614016 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60bf22b7-6587-4cbd-887c-a1e0c827f83b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:49.626854 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-60bf22b7-6587-4cbd-887c-a1e0c827f83b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] HTTP exception thrown: Instance cf497683-01c3-4106-adb0-36d23d564607 could not be found. Apr 11 14:02:49.627446 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-60bf22b7-6587-4cbd-887c-a1e0c827f83b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Returning 404 to user: Instance cf497683-01c3-4106-adb0-36d23d564607 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:02:49.628506 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-60bf22b7-6587-4cbd-887c-a1e0c827f83b tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607" status: 404 len: 111 microversion: 2.20 time: 0.028179 Apr 11 14:02:49.629018 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 434/872] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:02:49 2022] GET /compute/v2.1/servers/cf497683-01c3-4106-adb0-36d23d564607 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 14:02:52.851557 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a41ca83a-08a1-4bb3-9c3b-48039d78ff14 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:52.852079 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a41ca83a-08a1-4bb3-9c3b-48039d78ff14 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:52.858225 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a41ca83a-08a1-4bb3-9c3b-48039d78ff14 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:52.858660 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a41ca83a-08a1-4bb3-9c3b-48039d78ff14 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:52.859418 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a41ca83a-08a1-4bb3-9c3b-48039d78ff14 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:52.859877 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a41ca83a-08a1-4bb3-9c3b-48039d78ff14 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:52.872978 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-a41ca83a-08a1-4bb3-9c3b-48039d78ff14 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] HTTP exception thrown: Instance 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f could not be found. Apr 11 14:02:52.873561 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a41ca83a-08a1-4bb3-9c3b-48039d78ff14 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Returning 404 to user: Instance 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:02:52.874381 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a41ca83a-08a1-4bb3-9c3b-48039d78ff14 tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 404 len: 111 microversion: 2.20 time: 0.026765 Apr 11 14:02:52.874902 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 439/873] 10.222.0.67 () {60 vars in 1279 bytes} [Mon Apr 11 14:02:52 2022] DELETE /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 14:02:52.882781 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-741e4b79-c1b7-4ff2-97a1-ef41b224527f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:52.883401 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-741e4b79-c1b7-4ff2-97a1-ef41b224527f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] [instance: 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:02:52.889739 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-741e4b79-c1b7-4ff2-97a1-ef41b224527f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:52.890199 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-741e4b79-c1b7-4ff2-97a1-ef41b224527f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:52.890968 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-741e4b79-c1b7-4ff2-97a1-ef41b224527f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:02:52.891405 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-741e4b79-c1b7-4ff2-97a1-ef41b224527f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:02:52.906826 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-741e4b79-c1b7-4ff2-97a1-ef41b224527f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] HTTP exception thrown: Instance 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f could not be found. Apr 11 14:02:52.907404 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-741e4b79-c1b7-4ff2-97a1-ef41b224527f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] Returning 404 to user: Instance 0d5f3b7d-8b92-4264-b41a-1d1ade879f2f could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:02:52.908250 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-741e4b79-c1b7-4ff2-97a1-ef41b224527f tempest-AttachVolumeShelveTestJSON-1398444303 tempest-AttachVolumeShelveTestJSON-1398444303-project] 10.222.0.67 "GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f" status: 404 len: 111 microversion: 2.20 time: 0.029462 Apr 11 14:02:52.909351 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 435/874] 10.222.0.67 () {60 vars in 1276 bytes} [Mon Apr 11 14:02:52 2022] GET /compute/v2.1/servers/0d5f3b7d-8b92-4264-b41a-1d1ade879f2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 11 14:02:57.331942 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e1711a8c-9ade-4a75-9354-92a09abf53fe tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Action: 'create', calling method: .version_select at 0x7f730bb40700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2002489382"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:57.615325 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e1711a8c-9ade-4a75-9354-92a09abf53fe tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.390809 Apr 11 14:02:57.616229 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 440/875] 10.222.0.67 () {60 vars in 1154 bytes} [Mon Apr 11 14:02:57 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 392 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 11 14:02:57.626681 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0801ee6f-67f4-4ec6-b073-9cecb7ba9a8d tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f73067c3820>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:57.699124 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0801ee6f-67f4-4ec6-b073-9cecb7ba9a8d tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402" status: 200 len: 345 microversion: 2.1 time: 0.076025 Apr 11 14:02:57.699674 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 436/876] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 14:02:57 2022] GET /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402 => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:58.712773 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1b1ab029-a16c-4821-894d-5596250e2a12 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f73069f69d0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:58.759538 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1b1ab029-a16c-4821-894d-5596250e2a12 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402" status: 200 len: 346 microversion: 2.1 time: 0.051248 Apr 11 14:02:58.760190 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 441/877] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 14:02:58 2022] GET /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:58.772563 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0a0c5d04-48b5-480d-8802-e7a16e3cbd78 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Action: 'create', calling method: .version_select at 0x7f730693e940>, body: {"snapshot": {"volume_id": "f9f00fa2-7528-4501-b45d-ee8d51523402", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-33882872"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:02:58.914853 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0a0c5d04-48b5-480d-8802-e7a16e3cbd78 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.147430 Apr 11 14:02:58.915479 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 437/878] 10.222.0.67 () {60 vars in 1161 bytes} [Mon Apr 11 14:02:58 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:58.926192 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c4bf6e77-bca0-4fab-a4b9-146bccac1968 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f730bb1a940>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:58.958819 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c4bf6e77-bca0-4fab-a4b9-146bccac1968 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd" status: 200 len: 285 microversion: 2.1 time: 0.037315 Apr 11 14:02:58.959426 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 442/879] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Apr 11 14:02:58 2022] GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd => generated 285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:58.970263 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8c98479b-9c9f-47b2-b8c9-c8d92584b830 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f730698ec10>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:58.999134 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8c98479b-9c9f-47b2-b8c9-c8d92584b830 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.032922 Apr 11 14:02:58.999723 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 438/880] 10.222.0.67 () {58 vars in 1139 bytes} [Mon Apr 11 14:02:58 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:02:59.010351 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4eb5f7a5-45cf-44fb-99ec-4226a92f37a8 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f73069f6ee0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:02:59.039545 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4eb5f7a5-45cf-44fb-99ec-4226a92f37a8 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd" status: 200 len: 285 microversion: 2.1 time: 0.032885 Apr 11 14:02:59.040136 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 443/881] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Apr 11 14:02:59 2022] GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd => generated 285 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:00.052139 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3a297bc3-8088-41fd-a593-a8593c11ce6b tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f73067c3430>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:00.079971 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3a297bc3-8088-41fd-a593-a8593c11ce6b tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd" status: 200 len: 285 microversion: 2.1 time: 0.032577 Apr 11 14:03:00.080536 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 439/882] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Apr 11 14:03:00 2022] GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd => generated 285 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:01.092162 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7ec5d4e6-5a9b-43de-a3dc-acc3e53e4d15 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f730bb40040>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:01.121837 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7ec5d4e6-5a9b-43de-a3dc-acc3e53e4d15 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd" status: 200 len: 285 microversion: 2.1 time: 0.033942 Apr 11 14:03:01.122411 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 444/883] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Apr 11 14:03:01 2022] GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:02.134175 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6e6f8d23-1ec3-47b2-9905-a1a76636150f tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f730756edc0>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:02.163996 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6e6f8d23-1ec3-47b2-9905-a1a76636150f tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd" status: 200 len: 285 microversion: 2.1 time: 0.034074 Apr 11 14:03:02.164561 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 440/884] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Apr 11 14:03:02 2022] GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:02.841492 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a74ea91a-5cd8-4d6c-9784-2f3fe397320e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:02.842110 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a74ea91a-5cd8-4d6c-9784-2f3fe397320e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:02.848222 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a74ea91a-5cd8-4d6c-9784-2f3fe397320e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:02.848676 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a74ea91a-5cd8-4d6c-9784-2f3fe397320e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:02.849448 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a74ea91a-5cd8-4d6c-9784-2f3fe397320e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:02.849884 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a74ea91a-5cd8-4d6c-9784-2f3fe397320e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:02.872558 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a74ea91a-5cd8-4d6c-9784-2f3fe397320e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a/ips" status: 200 len: 149 microversion: 2.1 time: 0.035490 Apr 11 14:03:02.873127 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 445/885] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Apr 11 14:03:02 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:02.884995 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-870426a4-f59a-497c-8f6c-abb783cd9911 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba7499e9-f494-4509-b60a-52f63de6ab10"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:02.886051 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-870426a4-f59a-497c-8f6c-abb783cd9911 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:02.892512 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-870426a4-f59a-497c-8f6c-abb783cd9911 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:02.892967 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-870426a4-f59a-497c-8f6c-abb783cd9911 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:02.893726 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-870426a4-f59a-497c-8f6c-abb783cd9911 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:02.894163 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-870426a4-f59a-497c-8f6c-abb783cd9911 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:02.968154 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-870426a4-f59a-497c-8f6c-abb783cd9911 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Invalid volume: volume ba7499e9-f494-4509-b60a-52f63de6ab10 is already attached to instances: b1c531fb-df98-4780-bea5-7b483075b4f9 Apr 11 14:03:02.968761 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-870426a4-f59a-497c-8f6c-abb783cd9911 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 400 to user: Invalid volume: volume ba7499e9-f494-4509-b60a-52f63de6ab10 is already attached to instances: b1c531fb-df98-4780-bea5-7b483075b4f9 {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:03:02.969603 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-870426a4-f59a-497c-8f6c-abb783cd9911 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "POST /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.088685 Apr 11 14:03:02.970151 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 441/886] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 14:03:02 2022] POST /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a/os-volume_attachments => generated 174 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 14:03:02.978665 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a4fa60aa-88af-4cd1-a547-e2747be398d8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:02.979159 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a4fa60aa-88af-4cd1-a547-e2747be398d8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:02.985099 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4fa60aa-88af-4cd1-a547-e2747be398d8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:02.985553 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4fa60aa-88af-4cd1-a547-e2747be398d8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:02.986895 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4fa60aa-88af-4cd1-a547-e2747be398d8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:02.987327 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4fa60aa-88af-4cd1-a547-e2747be398d8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:03.010095 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a4fa60aa-88af-4cd1-a547-e2747be398d8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:03:03.082444 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a4fa60aa-88af-4cd1-a547-e2747be398d8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 204 len: 0 microversion: 2.1 time: 0.107115 Apr 11 14:03:03.083072 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 446/887] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:03:02 2022] DELETE /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:03:03.091168 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-781d00d9-63cd-4fb9-8816-662bf02e067b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:03.091847 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-781d00d9-63cd-4fb9-8816-662bf02e067b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:03.100253 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-781d00d9-63cd-4fb9-8816-662bf02e067b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:03.100717 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-781d00d9-63cd-4fb9-8816-662bf02e067b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:03.101493 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-781d00d9-63cd-4fb9-8816-662bf02e067b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:03.101966 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-781d00d9-63cd-4fb9-8816-662bf02e067b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:03.176861 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0c5b3044-29b6-455b-af35-3277e437aed6 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f7306a67b80>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:03.205038 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0c5b3044-29b6-455b-af35-3277e437aed6 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd" status: 200 len: 285 microversion: 2.1 time: 0.032999 Apr 11 14:03:03.205631 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 447/888] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Apr 11 14:03:03 2022] GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:03:03.229762 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-781d00d9-63cd-4fb9-8816-662bf02e067b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:03.237762 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-781d00d9-63cd-4fb9-8816-662bf02e067b tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 200 len: 1680 microversion: 2.1 time: 0.149941 Apr 11 14:03:03.238419 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 442/889] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:03 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:04.217208 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a4426685-8c5d-4343-a57f-4f265aac97fb tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f7306b30a60>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:04.246301 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a4426685-8c5d-4343-a57f-4f265aac97fb tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd" status: 200 len: 286 microversion: 2.1 time: 0.033329 Apr 11 14:03:04.246854 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 448/890] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Apr 11 14:03:04 2022] GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:04.254447 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-eca52a0a-ab9c-4fea-88b3-8234d3211263 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:04.255078 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-eca52a0a-ab9c-4fea-88b3-8234d3211263 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:04.256724 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0f028f82-e04f-49ea-bc64-951a8d066e30 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f7306b30280>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:04.261469 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eca52a0a-ab9c-4fea-88b3-8234d3211263 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:04.261929 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eca52a0a-ab9c-4fea-88b3-8234d3211263 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:04.262708 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eca52a0a-ab9c-4fea-88b3-8234d3211263 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:04.263244 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eca52a0a-ab9c-4fea-88b3-8234d3211263 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:04.314257 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0f028f82-e04f-49ea-bc64-951a8d066e30 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd" status: 202 len: 0 microversion: 2.1 time: 0.061249 Apr 11 14:03:04.318237 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 449/891] 10.222.0.67 () {58 vars in 1253 bytes} [Mon Apr 11 14:03:04 2022] DELETE /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 14:03:04.325846 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-605ee49c-e67b-43ed-80cd-e1a9643ae008 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f7306b30af0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:04.355975 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-605ee49c-e67b-43ed-80cd-e1a9643ae008 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd" status: 200 len: 285 microversion: 2.1 time: 0.034047 Apr 11 14:03:04.356689 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 450/892] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Apr 11 14:03:04 2022] GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:04.402196 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-eca52a0a-ab9c-4fea-88b3-8234d3211263 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:04.410498 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-eca52a0a-ab9c-4fea-88b3-8234d3211263 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 200 len: 1680 microversion: 2.1 time: 0.160031 Apr 11 14:03:04.411102 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 443/893] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:04 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:05.367980 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bd3b88d9-e37a-4ad0-a9ad-50abca293773 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f7306a67d30>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:05.391670 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-bd3b88d9-e37a-4ad0-a9ad-50abca293773 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] HTTP exception thrown: Snapshot 2689c372-900f-4bb8-9585-5d3c50f84ecd could not be found. Apr 11 14:03:05.392285 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bd3b88d9-e37a-4ad0-a9ad-50abca293773 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Returning 404 to user: Snapshot 2689c372-900f-4bb8-9585-5d3c50f84ecd could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:03:05.393178 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bd3b88d9-e37a-4ad0-a9ad-50abca293773 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd" status: 404 len: 111 microversion: 2.1 time: 0.029618 Apr 11 14:03:05.394028 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 451/894] 10.222.0.67 () {58 vars in 1250 bytes} [Mon Apr 11 14:03:05 2022] GET /compute/v2.1/os-snapshots/2689c372-900f-4bb8-9585-5d3c50f84ecd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:03:05.402328 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6612e8b6-28af-4871-b7e6-f188f3dc4735 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f7306ac9550>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:05.429447 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4a044369-5e2c-4e3e-852e-5b37ef1c7ba5 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:05.430179 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4a044369-5e2c-4e3e-852e-5b37ef1c7ba5 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:05.435993 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4a044369-5e2c-4e3e-852e-5b37ef1c7ba5 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:05.436431 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4a044369-5e2c-4e3e-852e-5b37ef1c7ba5 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:05.437720 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4a044369-5e2c-4e3e-852e-5b37ef1c7ba5 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:05.437850 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4a044369-5e2c-4e3e-852e-5b37ef1c7ba5 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:05.465785 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6612e8b6-28af-4871-b7e6-f188f3dc4735 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402" status: 202 len: 0 microversion: 2.1 time: 0.067116 Apr 11 14:03:05.466981 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 444/895] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Apr 11 14:03:05 2022] DELETE /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:03:05.477890 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0311f12c-1475-4e83-b3f3-9a9be931102b tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f7306ba5e50>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:05.530989 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0311f12c-1475-4e83-b3f3-9a9be931102b tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402" status: 200 len: 345 microversion: 2.1 time: 0.060015 Apr 11 14:03:05.532017 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4a044369-5e2c-4e3e-852e-5b37ef1c7ba5 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:05.532163 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 445/896] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 14:03:05 2022] GET /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:03:05.540764 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4a044369-5e2c-4e3e-852e-5b37ef1c7ba5 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 200 len: 1613 microversion: 2.1 time: 0.117552 Apr 11 14:03:05.541331 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 452/897] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:05 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 1613 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:05.835488 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-9e7d0b04-407a-4cab-ad3a-ef85ec128434 req-3eda6b87-e9ca-4a62-8d91-67312ae5ea84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b16e2e-daa2-4b92-a76a-1616af70478a", "name": "network-vif-deleted", "tag": "a40b3497-1c52-41d9-96c8-2f72a240605d"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:05.849112 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-9e7d0b04-407a-4cab-ad3a-ef85ec128434 req-3eda6b87-e9ca-4a62-8d91-67312ae5ea84 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:05.850135 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-9e7d0b04-407a-4cab-ad3a-ef85ec128434 req-3eda6b87-e9ca-4a62-8d91-67312ae5ea84 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:05.865472 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-9e7d0b04-407a-4cab-ad3a-ef85ec128434 req-3eda6b87-e9ca-4a62-8d91-67312ae5ea84 service nova] Creating event network-vif-deleted:a40b3497-1c52-41d9-96c8-2f72a240605d for instance 14b16e2e-daa2-4b92-a76a-1616af70478a on hv-cinder-83078 Apr 11 14:03:05.874608 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-9e7d0b04-407a-4cab-ad3a-ef85ec128434 req-3eda6b87-e9ca-4a62-8d91-67312ae5ea84 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043926 Apr 11 14:03:05.875428 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 446/898] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:03:06.544634 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-03d72353-e1a1-4b42-983d-fbd6edd1acb8 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f7306a67ca0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:06.558387 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a2e3388a-6a6a-4bc9-8667-cde6e3b1492e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:06.559424 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a2e3388a-6a6a-4bc9-8667-cde6e3b1492e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:06.566707 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a2e3388a-6a6a-4bc9-8667-cde6e3b1492e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:06.567340 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a2e3388a-6a6a-4bc9-8667-cde6e3b1492e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:06.568287 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a2e3388a-6a6a-4bc9-8667-cde6e3b1492e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:06.568925 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a2e3388a-6a6a-4bc9-8667-cde6e3b1492e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:06.574781 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-03d72353-e1a1-4b42-983d-fbd6edd1acb8 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] HTTP exception thrown: Volume f9f00fa2-7528-4501-b45d-ee8d51523402 could not be found. Apr 11 14:03:06.575388 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-03d72353-e1a1-4b42-983d-fbd6edd1acb8 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Returning 404 to user: Volume f9f00fa2-7528-4501-b45d-ee8d51523402 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:03:06.576251 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-03d72353-e1a1-4b42-983d-fbd6edd1acb8 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402" status: 404 len: 109 microversion: 2.1 time: 0.035869 Apr 11 14:03:06.576955 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 453/899] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 14:03:06 2022] GET /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:03:06.584887 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-a2e3388a-6a6a-4bc9-8667-cde6e3b1492e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Instance 14b16e2e-daa2-4b92-a76a-1616af70478a could not be found. Apr 11 14:03:06.585995 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a2e3388a-6a6a-4bc9-8667-cde6e3b1492e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 404 to user: Instance 14b16e2e-daa2-4b92-a76a-1616af70478a could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:03:06.586855 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a2e3388a-6a6a-4bc9-8667-cde6e3b1492e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 404 len: 111 microversion: 2.1 time: 0.032900 Apr 11 14:03:06.590294 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a6ae236d-3616-4158-b700-d3de33308a8d tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f73069f65e0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:06.591167 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 447/900] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:06 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:03:06.595877 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fe1a1c1a-7f3e-44be-9d08-d0e3da94869d tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '.version_select at 0x7f730684a940>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:06.616158 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fe1a1c1a-7f3e-44be-9d08-d0e3da94869d tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-892962934" status: 202 len: 0 microversion: 2.1 time: 0.023831 Apr 11 14:03:06.616748 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 448/901] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Apr 11 14:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-892962934 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:03:06.621298 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-a6ae236d-3616-4158-b700-d3de33308a8d tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] HTTP exception thrown: Volume f9f00fa2-7528-4501-b45d-ee8d51523402 could not be found. Apr 11 14:03:06.621907 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a6ae236d-3616-4158-b700-d3de33308a8d tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Returning 404 to user: Volume f9f00fa2-7528-4501-b45d-ee8d51523402 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:03:06.622736 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a6ae236d-3616-4158-b700-d3de33308a8d tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402" status: 404 len: 109 microversion: 2.1 time: 0.036233 Apr 11 14:03:06.627113 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 454/902] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Apr 11 14:03:06 2022] DELETE /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 14:03:06.636169 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6048513a-745b-4a5a-bf0f-114934fe34d9 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Calling method '.version_select at 0x7f730693e430>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:06.664850 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-6048513a-745b-4a5a-bf0f-114934fe34d9 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] HTTP exception thrown: Volume f9f00fa2-7528-4501-b45d-ee8d51523402 could not be found. Apr 11 14:03:06.665463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6048513a-745b-4a5a-bf0f-114934fe34d9 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] Returning 404 to user: Volume f9f00fa2-7528-4501-b45d-ee8d51523402 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:03:06.666322 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6048513a-745b-4a5a-bf0f-114934fe34d9 tempest-VolumesSnapshotsTestJSON-459654726 tempest-VolumesSnapshotsTestJSON-459654726-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402" status: 404 len: 109 microversion: 2.1 time: 0.039116 Apr 11 14:03:06.666882 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 449/903] 10.222.0.67 () {58 vars in 1244 bytes} [Mon Apr 11 14:03:06 2022] GET /compute/v2.1/os-volumes/f9f00fa2-7528-4501-b45d-ee8d51523402 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 14:03:07.520223 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5551269b-1c6b-4651-92fb-52a2b12afc50 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:07.520807 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5551269b-1c6b-4651-92fb-52a2b12afc50 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:07.527402 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5551269b-1c6b-4651-92fb-52a2b12afc50 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:07.527980 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5551269b-1c6b-4651-92fb-52a2b12afc50 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:07.528801 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5551269b-1c6b-4651-92fb-52a2b12afc50 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:07.529192 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5551269b-1c6b-4651-92fb-52a2b12afc50 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:07.631903 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-5551269b-1c6b-4651-92fb-52a2b12afc50 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lazy-loading 'services' on Instance uuid b1c531fb-df98-4780-bea5-7b483075b4f9 {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:03:07.722984 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5551269b-1c6b-4651-92fb-52a2b12afc50 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9/os-volume_attachments/ba7499e9-f494-4509-b60a-52f63de6ab10" status: 202 len: 0 microversion: 2.1 time: 0.208430 Apr 11 14:03:07.723822 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 455/904] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Apr 11 14:03:07 2022] DELETE /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9/os-volume_attachments/ba7499e9-f494-4509-b60a-52f63de6ab10 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:03:07.739908 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7c48daf7-b4e6-45d3-b182-b0123750fe47 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:07.742857 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7c48daf7-b4e6-45d3-b182-b0123750fe47 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:07.751225 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7c48daf7-b4e6-45d3-b182-b0123750fe47 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:07.751745 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7c48daf7-b4e6-45d3-b182-b0123750fe47 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:07.752818 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7c48daf7-b4e6-45d3-b182-b0123750fe47 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:07.753428 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7c48daf7-b4e6-45d3-b182-b0123750fe47 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:07.792557 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7c48daf7-b4e6-45d3-b182-b0123750fe47 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064399 Apr 11 14:03:07.793123 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 450/905] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:03:07 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:08.805184 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b2355ea1-3d7e-47b2-884e-c75c0336bd4e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:08.807149 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b2355ea1-3d7e-47b2-884e-c75c0336bd4e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:08.815941 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2355ea1-3d7e-47b2-884e-c75c0336bd4e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:08.816736 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2355ea1-3d7e-47b2-884e-c75c0336bd4e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:08.818342 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2355ea1-3d7e-47b2-884e-c75c0336bd4e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:08.819044 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2355ea1-3d7e-47b2-884e-c75c0336bd4e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:08.854584 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b2355ea1-3d7e-47b2-884e-c75c0336bd4e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054251 Apr 11 14:03:08.855359 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 456/906] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:03:08 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 14:03:08.924674 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-515e12a7-6fc1-4e38-a266-6246174bb5d6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:08.925351 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-515e12a7-6fc1-4e38-a266-6246174bb5d6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:08.933107 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-515e12a7-6fc1-4e38-a266-6246174bb5d6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:08.933699 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-515e12a7-6fc1-4e38-a266-6246174bb5d6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:08.934530 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-515e12a7-6fc1-4e38-a266-6246174bb5d6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:08.935026 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-515e12a7-6fc1-4e38-a266-6246174bb5d6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:08.963770 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-515e12a7-6fc1-4e38-a266-6246174bb5d6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:03:09.047427 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-515e12a7-6fc1-4e38-a266-6246174bb5d6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 204 len: 0 microversion: 2.1 time: 0.126954 Apr 11 14:03:09.048610 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 451/907] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:03:08 2022] DELETE /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 14:03:09.058062 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b5611c9c-8d5f-4ddf-a49d-2e349e026b2d tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:09.058861 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b5611c9c-8d5f-4ddf-a49d-2e349e026b2d tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:09.066860 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b5611c9c-8d5f-4ddf-a49d-2e349e026b2d tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:09.067313 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b5611c9c-8d5f-4ddf-a49d-2e349e026b2d tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:09.068106 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b5611c9c-8d5f-4ddf-a49d-2e349e026b2d tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:09.068543 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b5611c9c-8d5f-4ddf-a49d-2e349e026b2d tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:09.296521 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b5611c9c-8d5f-4ddf-a49d-2e349e026b2d tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:09.305047 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b5611c9c-8d5f-4ddf-a49d-2e349e026b2d tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1683 microversion: 2.1 time: 0.250797 Apr 11 14:03:09.305826 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 457/908] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:09 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1683 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:10.327851 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-338339c5-95af-4b4a-a777-8c176c487a7c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:10.328554 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-338339c5-95af-4b4a-a777-8c176c487a7c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:10.334616 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-338339c5-95af-4b4a-a777-8c176c487a7c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:10.335301 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-338339c5-95af-4b4a-a777-8c176c487a7c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:10.336101 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-338339c5-95af-4b4a-a777-8c176c487a7c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:10.336536 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-338339c5-95af-4b4a-a777-8c176c487a7c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:10.489740 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-338339c5-95af-4b4a-a777-8c176c487a7c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:10.498345 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-338339c5-95af-4b4a-a777-8c176c487a7c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1683 microversion: 2.1 time: 0.174670 Apr 11 14:03:10.499594 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 452/909] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:10 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:03:11.515911 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c21d2482-e130-41f3-82e2-3797311a8639 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:11.516528 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c21d2482-e130-41f3-82e2-3797311a8639 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:11.523802 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c21d2482-e130-41f3-82e2-3797311a8639 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:11.524256 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c21d2482-e130-41f3-82e2-3797311a8639 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:11.525005 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c21d2482-e130-41f3-82e2-3797311a8639 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:11.525435 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c21d2482-e130-41f3-82e2-3797311a8639 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:11.650224 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c21d2482-e130-41f3-82e2-3797311a8639 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:11.657383 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c21d2482-e130-41f3-82e2-3797311a8639 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1683 microversion: 2.1 time: 0.145264 Apr 11 14:03:11.657937 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 458/910] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:11 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1683 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:12.673476 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-87b99bca-6f98-473c-939f-ce30abd8bb52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:12.674513 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-87b99bca-6f98-473c-939f-ce30abd8bb52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:12.680801 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-87b99bca-6f98-473c-939f-ce30abd8bb52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:12.681257 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-87b99bca-6f98-473c-939f-ce30abd8bb52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:12.682023 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-87b99bca-6f98-473c-939f-ce30abd8bb52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:12.682462 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-87b99bca-6f98-473c-939f-ce30abd8bb52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:12.808160 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-87b99bca-6f98-473c-939f-ce30abd8bb52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:12.815485 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-87b99bca-6f98-473c-939f-ce30abd8bb52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1683 microversion: 2.1 time: 0.145938 Apr 11 14:03:12.816095 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 453/911] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:12 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1683 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:13.832865 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d7a865db-4d30-4a13-b515-f1104305d0ec tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:13.833473 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d7a865db-4d30-4a13-b515-f1104305d0ec tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:13.839566 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7a865db-4d30-4a13-b515-f1104305d0ec tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:13.840168 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7a865db-4d30-4a13-b515-f1104305d0ec tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:13.840945 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7a865db-4d30-4a13-b515-f1104305d0ec tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:13.841378 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7a865db-4d30-4a13-b515-f1104305d0ec tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:13.905983 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d7a865db-4d30-4a13-b515-f1104305d0ec tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:13.914039 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d7a865db-4d30-4a13-b515-f1104305d0ec tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1615 microversion: 2.1 time: 0.085604 Apr 11 14:03:13.914550 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 459/912] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:13 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1615 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:14.081463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-26c0d0c4-920d-4b68-93f1-b145c7651475 req-0de77966-9fc4-4e3b-80dd-eae030e75146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c531fb-df98-4780-bea5-7b483075b4f9", "name": "network-vif-deleted", "tag": "99983948-a76f-4e70-b04a-dfb2433aaa98"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:14.092628 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-26c0d0c4-920d-4b68-93f1-b145c7651475 req-0de77966-9fc4-4e3b-80dd-eae030e75146 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:14.093306 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-26c0d0c4-920d-4b68-93f1-b145c7651475 req-0de77966-9fc4-4e3b-80dd-eae030e75146 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:14.105030 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-26c0d0c4-920d-4b68-93f1-b145c7651475 req-0de77966-9fc4-4e3b-80dd-eae030e75146 service nova] Creating event network-vif-deleted:99983948-a76f-4e70-b04a-dfb2433aaa98 for instance b1c531fb-df98-4780-bea5-7b483075b4f9 on hv-cinder-83078 Apr 11 14:03:14.110468 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-26c0d0c4-920d-4b68-93f1-b145c7651475 req-0de77966-9fc4-4e3b-80dd-eae030e75146 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033795 Apr 11 14:03:14.111115 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 454/913] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:14.932021 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-379851b2-0355-481b-9db8-6d721b970a60 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:14.932645 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-379851b2-0355-481b-9db8-6d721b970a60 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:14.939663 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-379851b2-0355-481b-9db8-6d721b970a60 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:14.940118 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-379851b2-0355-481b-9db8-6d721b970a60 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:14.941081 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-379851b2-0355-481b-9db8-6d721b970a60 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:14.941513 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-379851b2-0355-481b-9db8-6d721b970a60 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:15.005941 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-379851b2-0355-481b-9db8-6d721b970a60 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:15.013311 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-379851b2-0355-481b-9db8-6d721b970a60 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1326 microversion: 2.1 time: 0.085456 Apr 11 14:03:15.013870 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 460/914] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:14 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1326 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:16.030783 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-819b7b43-6e5b-4bee-80c3-a7bb2e522fc0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:16.031442 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-819b7b43-6e5b-4bee-80c3-a7bb2e522fc0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:16.038681 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-819b7b43-6e5b-4bee-80c3-a7bb2e522fc0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:16.039168 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-819b7b43-6e5b-4bee-80c3-a7bb2e522fc0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:16.039970 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-819b7b43-6e5b-4bee-80c3-a7bb2e522fc0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:16.040416 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-819b7b43-6e5b-4bee-80c3-a7bb2e522fc0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:16.103107 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-819b7b43-6e5b-4bee-80c3-a7bb2e522fc0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:16.110411 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-819b7b43-6e5b-4bee-80c3-a7bb2e522fc0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 200 len: 1326 microversion: 2.1 time: 0.083893 Apr 11 14:03:16.111335 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 455/915] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:16 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 1326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:17.128216 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-220f1b0c-5ffc-47b3-980b-64374f37ecf6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:17.128844 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-220f1b0c-5ffc-47b3-980b-64374f37ecf6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:17.135503 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-220f1b0c-5ffc-47b3-980b-64374f37ecf6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:17.135987 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-220f1b0c-5ffc-47b3-980b-64374f37ecf6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:17.136754 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-220f1b0c-5ffc-47b3-980b-64374f37ecf6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:17.137187 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-220f1b0c-5ffc-47b3-980b-64374f37ecf6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:17.150160 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-220f1b0c-5ffc-47b3-980b-64374f37ecf6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Instance b1c531fb-df98-4780-bea5-7b483075b4f9 could not be found. Apr 11 14:03:17.150734 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-220f1b0c-5ffc-47b3-980b-64374f37ecf6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 404 to user: Instance b1c531fb-df98-4780-bea5-7b483075b4f9 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:03:17.151555 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-220f1b0c-5ffc-47b3-980b-64374f37ecf6 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 404 len: 111 microversion: 2.1 time: 0.027942 Apr 11 14:03:17.152088 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 461/916] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:17 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:03:17.160281 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ae44c7ff-59af-46e1-81eb-9dc38a6b028f tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '.version_select at 0x7f73067c3550>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:17.177904 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ae44c7ff-59af-46e1-81eb-9dc38a6b028f tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079818213" status: 202 len: 0 microversion: 2.1 time: 0.021389 Apr 11 14:03:17.178471 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 456/917] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Apr 11 14:03:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079818213 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:03:17.787295 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8e3886d9-7c27-47f5-8f69-fe7cd05c2795 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Action: 'create', calling method: .version_select at 0x7f7306a2bee0>, body: {"keypair": {"name": "tempest-keypair-314550408"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:17.800862 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-8e3886d9-7c27-47f5-8f69-fe7cd05c2795 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:03:17.804541 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-8e3886d9-7c27-47f5-8f69-fe7cd05c2795 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for user 2cbcdc40fea745f48e1dfc62a732b7ee and project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:03:17.967989 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-8e3886d9-7c27-47f5-8f69-fe7cd05c2795 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:03:17.971879 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-8e3886d9-7c27-47f5-8f69-fe7cd05c2795 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for user 2cbcdc40fea745f48e1dfc62a732b7ee and project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:03:17.985126 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8e3886d9-7c27-47f5-8f69-fe7cd05c2795 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.202228 Apr 11 14:03:17.985809 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 462/918] 10.222.0.67 () {60 vars in 1157 bytes} [Mon Apr 11 14:03:17 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:19.206877 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1081623305", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "730a24f2-5d00-49fb-895d-b884d9163131"}], "security_groups": [{"name": "tempest-securitygroup--411169884"}], "key_name": "tempest-keypair-314550408", "user_data": "}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:19.305371 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] validate_networks() for [('730a24f2-5d00-49fb-895d-b884d9163131', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 14:03:19.667214 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 14:03:19.667669 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 14:03:19.668145 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 14:03:19.668556 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 14:03:19.669121 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 14:03:19.677988 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:19.678441 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:19.679236 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:19.679703 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:19.696401 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:03:19.700313 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for user 2cbcdc40fea745f48e1dfc62a732b7ee and project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:03:19.711893 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 14:03:19.714281 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 14:03:19.761095 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-950d124f-97ce-46b5-92eb-db849c51e876 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.559272 Apr 11 14:03:19.761961 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 457/919] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 14:03:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 14:03:19.773098 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0242fe63-d686-4763-9ee6-c12dca1818c8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:19.773757 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0242fe63-d686-4763-9ee6-c12dca1818c8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:19.835202 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0242fe63-d686-4763-9ee6-c12dca1818c8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:19.842794 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0242fe63-d686-4763-9ee6-c12dca1818c8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 200 len: 1241 microversion: 2.1 time: 0.073774 Apr 11 14:03:19.843666 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 463/920] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:19 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:20.859961 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bce88615-f484-4bce-b0c2-663ce28ef282 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:20.861154 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bce88615-f484-4bce-b0c2-663ce28ef282 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:20.867636 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bce88615-f484-4bce-b0c2-663ce28ef282 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:20.868112 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bce88615-f484-4bce-b0c2-663ce28ef282 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:20.868880 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bce88615-f484-4bce-b0c2-663ce28ef282 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:20.869319 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bce88615-f484-4bce-b0c2-663ce28ef282 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:20.933715 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-bce88615-f484-4bce-b0c2-663ce28ef282 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:20.941840 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bce88615-f484-4bce-b0c2-663ce28ef282 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 200 len: 1299 microversion: 2.1 time: 0.086170 Apr 11 14:03:20.942551 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 458/921] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:20 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:21.960830 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4678e6f6-82d9-4a06-8e8f-ee1bc9183464 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:21.961539 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4678e6f6-82d9-4a06-8e8f-ee1bc9183464 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:21.967936 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4678e6f6-82d9-4a06-8e8f-ee1bc9183464 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:21.968703 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4678e6f6-82d9-4a06-8e8f-ee1bc9183464 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:21.969787 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4678e6f6-82d9-4a06-8e8f-ee1bc9183464 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:21.970496 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4678e6f6-82d9-4a06-8e8f-ee1bc9183464 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:22.187346 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-760a7710-ab67-48d2-a15e-f8aa5e5ff12c req-eea95bba-b80c-4b19-a208-39336a91fe43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e427eb53-7ff8-42d2-a90e-b07c69fc0a86", "tag": "439feed1-351c-4939-9798-5d72e310c897"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:22.200628 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4678e6f6-82d9-4a06-8e8f-ee1bc9183464 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:22.212400 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4678e6f6-82d9-4a06-8e8f-ee1bc9183464 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 200 len: 1366 microversion: 2.1 time: 0.255544 Apr 11 14:03:22.212985 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 464/922] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:21 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:22.217127 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-760a7710-ab67-48d2-a15e-f8aa5e5ff12c req-eea95bba-b80c-4b19-a208-39336a91fe43 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:22.217579 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-760a7710-ab67-48d2-a15e-f8aa5e5ff12c req-eea95bba-b80c-4b19-a208-39336a91fe43 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:22.232450 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-760a7710-ab67-48d2-a15e-f8aa5e5ff12c req-eea95bba-b80c-4b19-a208-39336a91fe43 service nova] Creating event network-changed:439feed1-351c-4939-9798-5d72e310c897 for instance e427eb53-7ff8-42d2-a90e-b07c69fc0a86 on hv-cinder-83078 Apr 11 14:03:22.238935 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-760a7710-ab67-48d2-a15e-f8aa5e5ff12c req-eea95bba-b80c-4b19-a208-39336a91fe43 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058500 Apr 11 14:03:22.239390 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 459/923] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:23.229272 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c26bdf6c-f636-4244-82be-8e5015c2f077 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:23.229919 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c26bdf6c-f636-4244-82be-8e5015c2f077 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:23.236322 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c26bdf6c-f636-4244-82be-8e5015c2f077 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:23.236803 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c26bdf6c-f636-4244-82be-8e5015c2f077 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:23.237568 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c26bdf6c-f636-4244-82be-8e5015c2f077 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:23.238001 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c26bdf6c-f636-4244-82be-8e5015c2f077 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:23.364015 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c26bdf6c-f636-4244-82be-8e5015c2f077 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:23.372107 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c26bdf6c-f636-4244-82be-8e5015c2f077 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 200 len: 1366 microversion: 2.1 time: 0.146950 Apr 11 14:03:23.372685 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 465/924] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:23 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:24.390091 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7062fc3f-338a-49c3-8312-9d0717be6717 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:24.390798 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7062fc3f-338a-49c3-8312-9d0717be6717 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:24.398264 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7062fc3f-338a-49c3-8312-9d0717be6717 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:24.398721 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7062fc3f-338a-49c3-8312-9d0717be6717 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:24.399497 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7062fc3f-338a-49c3-8312-9d0717be6717 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:24.399966 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7062fc3f-338a-49c3-8312-9d0717be6717 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:24.524647 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7062fc3f-338a-49c3-8312-9d0717be6717 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:24.532819 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7062fc3f-338a-49c3-8312-9d0717be6717 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 200 len: 1366 microversion: 2.1 time: 0.146274 Apr 11 14:03:24.533411 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 460/925] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:24 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:25.550136 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-19191176-8634-4658-b02d-b4ca8be1514f tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:25.550774 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-19191176-8634-4658-b02d-b4ca8be1514f tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:25.557749 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19191176-8634-4658-b02d-b4ca8be1514f tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:25.558358 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19191176-8634-4658-b02d-b4ca8be1514f tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:25.559219 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19191176-8634-4658-b02d-b4ca8be1514f tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:25.559685 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19191176-8634-4658-b02d-b4ca8be1514f tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:25.701965 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-19191176-8634-4658-b02d-b4ca8be1514f tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:25.709924 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-19191176-8634-4658-b02d-b4ca8be1514f tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 200 len: 1366 microversion: 2.1 time: 0.164039 Apr 11 14:03:25.710536 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 466/926] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:25 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:26.684593 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-e7e65183-3744-42e3-90c4-d0e4d110ce09 req-12fe55f5-759d-4d23-ab74-6f949bffd4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e427eb53-7ff8-42d2-a90e-b07c69fc0a86", "name": "network-vif-plugged", "status": "completed", "tag": "439feed1-351c-4939-9798-5d72e310c897"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:26.695430 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-e7e65183-3744-42e3-90c4-d0e4d110ce09 req-12fe55f5-759d-4d23-ab74-6f949bffd4ca service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:26.696061 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-e7e65183-3744-42e3-90c4-d0e4d110ce09 req-12fe55f5-759d-4d23-ab74-6f949bffd4ca service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:26.708442 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-e7e65183-3744-42e3-90c4-d0e4d110ce09 req-12fe55f5-759d-4d23-ab74-6f949bffd4ca service nova] Creating event network-vif-plugged:439feed1-351c-4939-9798-5d72e310c897 for instance e427eb53-7ff8-42d2-a90e-b07c69fc0a86 on hv-cinder-83078 Apr 11 14:03:26.713647 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-e7e65183-3744-42e3-90c4-d0e4d110ce09 req-12fe55f5-759d-4d23-ab74-6f949bffd4ca service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032973 Apr 11 14:03:26.714747 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 461/927] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:26.726342 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6804174c-4cdb-473b-b272-447c90373d10 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:26.727013 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6804174c-4cdb-473b-b272-447c90373d10 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:26.733655 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6804174c-4cdb-473b-b272-447c90373d10 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:26.734111 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6804174c-4cdb-473b-b272-447c90373d10 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:26.735591 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6804174c-4cdb-473b-b272-447c90373d10 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:26.736333 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6804174c-4cdb-473b-b272-447c90373d10 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:26.913292 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6804174c-4cdb-473b-b272-447c90373d10 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:26.920941 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6804174c-4cdb-473b-b272-447c90373d10 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 200 len: 1366 microversion: 2.1 time: 0.198550 Apr 11 14:03:26.921546 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 467/928] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:26 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:27.938830 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4dbd24bf-4ab8-455b-908a-85848bda7f4a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:27.939546 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4dbd24bf-4ab8-455b-908a-85848bda7f4a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:27.945635 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4dbd24bf-4ab8-455b-908a-85848bda7f4a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:27.946091 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4dbd24bf-4ab8-455b-908a-85848bda7f4a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:27.946866 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4dbd24bf-4ab8-455b-908a-85848bda7f4a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:27.947313 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4dbd24bf-4ab8-455b-908a-85848bda7f4a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:28.074521 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4dbd24bf-4ab8-455b-908a-85848bda7f4a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:28.082587 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4dbd24bf-4ab8-455b-908a-85848bda7f4a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 200 len: 1366 microversion: 2.1 time: 0.149117 Apr 11 14:03:28.083193 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 462/929] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:27 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:29.100154 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5c1e7500-288b-4db5-90eb-ea75fe86b712 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:29.100886 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5c1e7500-288b-4db5-90eb-ea75fe86b712 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:29.107451 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c1e7500-288b-4db5-90eb-ea75fe86b712 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:29.108065 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c1e7500-288b-4db5-90eb-ea75fe86b712 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:29.109068 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c1e7500-288b-4db5-90eb-ea75fe86b712 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:29.109617 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c1e7500-288b-4db5-90eb-ea75fe86b712 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:29.287424 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5c1e7500-288b-4db5-90eb-ea75fe86b712 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:29.294631 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5c1e7500-288b-4db5-90eb-ea75fe86b712 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 200 len: 1556 microversion: 2.1 time: 0.198392 Apr 11 14:03:29.295211 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 468/930] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:29 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 1556 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:29.312158 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3138a45d-ed0a-4b63-ae4c-d50e6707c4da tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:29.313228 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3138a45d-ed0a-4b63-ae4c-d50e6707c4da tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:29.319861 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3138a45d-ed0a-4b63-ae4c-d50e6707c4da tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:29.320320 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3138a45d-ed0a-4b63-ae4c-d50e6707c4da tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:29.321097 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3138a45d-ed0a-4b63-ae4c-d50e6707c4da tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:29.321535 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3138a45d-ed0a-4b63-ae4c-d50e6707c4da tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:29.402804 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3138a45d-ed0a-4b63-ae4c-d50e6707c4da tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094661 Apr 11 14:03:29.403970 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 463/931] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Apr 11 14:03:29 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:30.620047 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-92b31c70-eef9-403d-bcdf-a74e11c7826a req-5b2dda79-428b-4931-826b-ca9ac70948eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e427eb53-7ff8-42d2-a90e-b07c69fc0a86", "tag": "439feed1-351c-4939-9798-5d72e310c897"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:30.632866 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-92b31c70-eef9-403d-bcdf-a74e11c7826a req-5b2dda79-428b-4931-826b-ca9ac70948eb service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:30.633603 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-92b31c70-eef9-403d-bcdf-a74e11c7826a req-5b2dda79-428b-4931-826b-ca9ac70948eb service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:30.646550 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-92b31c70-eef9-403d-bcdf-a74e11c7826a req-5b2dda79-428b-4931-826b-ca9ac70948eb service nova] Creating event network-changed:439feed1-351c-4939-9798-5d72e310c897 for instance e427eb53-7ff8-42d2-a90e-b07c69fc0a86 on hv-cinder-83078 Apr 11 14:03:30.652264 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-92b31c70-eef9-403d-bcdf-a74e11c7826a req-5b2dda79-428b-4931-826b-ca9ac70948eb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035725 Apr 11 14:03:30.653035 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 469/932] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:37.769000 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-08bba032-9d53-496a-a843-251552c0ea8e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:37.769518 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-08bba032-9d53-496a-a843-251552c0ea8e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:37.772564 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-9de4a22c-7d89-4a08-850f-9276c68413cb req-13c587bc-9475-4407-8013-956436b8f532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a988bf-9fbe-4371-a34f-2437494ec1ee", "tag": "2f18b7d6-84d7-4249-8b95-51fdbd414e68"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:37.775986 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-08bba032-9d53-496a-a843-251552c0ea8e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:37.776648 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-08bba032-9d53-496a-a843-251552c0ea8e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:37.777591 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-08bba032-9d53-496a-a843-251552c0ea8e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:37.778183 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-08bba032-9d53-496a-a843-251552c0ea8e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:37.784320 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-9de4a22c-7d89-4a08-850f-9276c68413cb req-13c587bc-9475-4407-8013-956436b8f532 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:37.785115 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-9de4a22c-7d89-4a08-850f-9276c68413cb req-13c587bc-9475-4407-8013-956436b8f532 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:37.800132 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-9de4a22c-7d89-4a08-850f-9276c68413cb req-13c587bc-9475-4407-8013-956436b8f532 service nova] Creating event network-changed:2f18b7d6-84d7-4249-8b95-51fdbd414e68 for instance e2a988bf-9fbe-4371-a34f-2437494ec1ee on hv-cinder-83078 Apr 11 14:03:37.803966 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-08bba032-9d53-496a-a843-251552c0ea8e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:03:37.805821 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-9de4a22c-7d89-4a08-850f-9276c68413cb req-13c587bc-9475-4407-8013-956436b8f532 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038123 Apr 11 14:03:37.806641 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 470/933] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:37.889540 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-08bba032-9d53-496a-a843-251552c0ea8e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 204 len: 0 microversion: 2.1 time: 0.124936 Apr 11 14:03:37.890170 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 464/934] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:03:37 2022] DELETE /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:03:37.899556 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-587764f7-ebd2-4729-bded-0facdbc9051e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:37.900377 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-587764f7-ebd2-4729-bded-0facdbc9051e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:37.906560 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-587764f7-ebd2-4729-bded-0facdbc9051e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:37.906997 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-587764f7-ebd2-4729-bded-0facdbc9051e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:37.907817 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-587764f7-ebd2-4729-bded-0facdbc9051e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:37.908243 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-587764f7-ebd2-4729-bded-0facdbc9051e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:38.082570 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-587764f7-ebd2-4729-bded-0facdbc9051e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:38.090146 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-587764f7-ebd2-4729-bded-0facdbc9051e tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.194962 Apr 11 14:03:38.090721 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 471/935] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:37 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:03:39.108543 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4b6b9e61-0c71-4909-a9df-d7f935fd29ae tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:39.110040 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4b6b9e61-0c71-4909-a9df-d7f935fd29ae tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:39.116419 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4b6b9e61-0c71-4909-a9df-d7f935fd29ae tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:39.116877 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4b6b9e61-0c71-4909-a9df-d7f935fd29ae tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:39.117644 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4b6b9e61-0c71-4909-a9df-d7f935fd29ae tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:39.118082 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4b6b9e61-0c71-4909-a9df-d7f935fd29ae tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:39.250258 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4b6b9e61-0c71-4909-a9df-d7f935fd29ae tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:39.257627 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4b6b9e61-0c71-4909-a9df-d7f935fd29ae tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1568 microversion: 2.1 time: 0.153265 Apr 11 14:03:39.258194 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 465/936] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:39 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:40.152074 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-9bafa46a-c647-433b-a972-aa507dba661e req-44e3d042-20e9-48c1-bb34-cbe330db2e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a988bf-9fbe-4371-a34f-2437494ec1ee", "name": "network-vif-deleted", "tag": "2f18b7d6-84d7-4249-8b95-51fdbd414e68"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:40.165331 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-9bafa46a-c647-433b-a972-aa507dba661e req-44e3d042-20e9-48c1-bb34-cbe330db2e08 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:40.166126 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-9bafa46a-c647-433b-a972-aa507dba661e req-44e3d042-20e9-48c1-bb34-cbe330db2e08 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:40.179791 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-9bafa46a-c647-433b-a972-aa507dba661e req-44e3d042-20e9-48c1-bb34-cbe330db2e08 service nova] Creating event network-vif-deleted:2f18b7d6-84d7-4249-8b95-51fdbd414e68 for instance e2a988bf-9fbe-4371-a34f-2437494ec1ee on hv-cinder-83078 Apr 11 14:03:40.185477 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-9bafa46a-c647-433b-a972-aa507dba661e req-44e3d042-20e9-48c1-bb34-cbe330db2e08 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037008 Apr 11 14:03:40.186351 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 472/937] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:40.274114 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-aa5be808-6577-426e-a745-8c3514e7d202 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:40.275265 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-aa5be808-6577-426e-a745-8c3514e7d202 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:40.282086 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aa5be808-6577-426e-a745-8c3514e7d202 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:40.282761 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aa5be808-6577-426e-a745-8c3514e7d202 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:40.283753 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aa5be808-6577-426e-a745-8c3514e7d202 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:40.284195 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aa5be808-6577-426e-a745-8c3514e7d202 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:40.354413 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-aa5be808-6577-426e-a745-8c3514e7d202 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd5089d5b5d4f71b5789cc10b7ff971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d5ba1efe34953a6d00b0f0afd5013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:40.365822 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-aa5be808-6577-426e-a745-8c3514e7d202 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 200 len: 1219 microversion: 2.1 time: 0.095335 Apr 11 14:03:40.366551 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 466/938] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:40 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:41.389459 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-73205bc2-c3c5-4314-a712-833415a7ec61 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:41.390806 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-73205bc2-c3c5-4314-a712-833415a7ec61 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] [instance: e2a988bf-9fbe-4371-a34f-2437494ec1ee] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:41.405825 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-73205bc2-c3c5-4314-a712-833415a7ec61 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:41.406367 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-73205bc2-c3c5-4314-a712-833415a7ec61 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:41.407153 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-73205bc2-c3c5-4314-a712-833415a7ec61 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:41.407591 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-73205bc2-c3c5-4314-a712-833415a7ec61 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:41.420591 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-73205bc2-c3c5-4314-a712-833415a7ec61 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] HTTP exception thrown: Instance e2a988bf-9fbe-4371-a34f-2437494ec1ee could not be found. Apr 11 14:03:41.421431 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-73205bc2-c3c5-4314-a712-833415a7ec61 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Returning 404 to user: Instance e2a988bf-9fbe-4371-a34f-2437494ec1ee could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:03:41.422307 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-73205bc2-c3c5-4314-a712-833415a7ec61 tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee" status: 404 len: 111 microversion: 2.1 time: 0.038055 Apr 11 14:03:41.422862 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 473/939] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:41 2022] GET /compute/v2.1/servers/e2a988bf-9fbe-4371-a34f-2437494ec1ee => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:03:41.594809 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-208663d3-3038-445d-b8b5-94e0855b906b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] Calling method '.version_select at 0x7f73068a4430>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:41.618973 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-208663d3-3038-445d-b8b5-94e0855b906b tempest-TestShelveInstance-72923974 tempest-TestShelveInstance-72923974-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1579021211" status: 202 len: 0 microversion: 2.1 time: 0.027584 Apr 11 14:03:41.619883 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 467/940] 10.222.0.67 () {58 vars in 1253 bytes} [Mon Apr 11 14:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1579021211 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:03:43.241136 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-217307233", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "networks": [{"uuid": "a46eb48f-c97d-43d9-b020-3606da009c33"}]}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:43.296445 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] validate_networks() for [('a46eb48f-c97d-43d9-b020-3606da009c33', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 14:03:44.047120 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 14:03:44.047542 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 14:03:44.048050 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 14:03:44.048468 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 14:03:44.048880 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 14:03:44.057378 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:44.057822 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:44.058619 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:44.059060 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:44.075539 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Getting quotas for project 7ea539d2e309403ab7ea0c5244a6d80f. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:03:44.079543 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Getting quotas for user b469e5f0479349c9bf61af6b1774583b and project 7ea539d2e309403ab7ea0c5244a6d80f. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:03:44.090242 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 14:03:44.092469 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 14:03:44.142011 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6541fdbc-1634-42da-b3ae-b5c42daa3a0d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904523 Apr 11 14:03:44.143031 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 474/941] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 14:03:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 14:03:44.153657 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-15e0fc59-b381-4724-b021-16831474d3d1 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:44.154354 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-15e0fc59-b381-4724-b021-16831474d3d1 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:44.211093 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-15e0fc59-b381-4724-b021-16831474d3d1 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:44.225327 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-15e0fc59-b381-4724-b021-16831474d3d1 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443" status: 200 len: 1213 microversion: 2.1 time: 0.076162 Apr 11 14:03:44.236733 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 468/942] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:44 2022] GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:45.243399 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0e054a52-3f12-4b44-a193-26832eea001c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:45.244132 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0e054a52-3f12-4b44-a193-26832eea001c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:45.254905 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e054a52-3f12-4b44-a193-26832eea001c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:45.255814 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e054a52-3f12-4b44-a193-26832eea001c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:45.256915 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e054a52-3f12-4b44-a193-26832eea001c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:45.257695 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e054a52-3f12-4b44-a193-26832eea001c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:45.353818 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0e054a52-3f12-4b44-a193-26832eea001c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:45.362082 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0e054a52-3f12-4b44-a193-26832eea001c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443" status: 200 len: 1273 microversion: 2.1 time: 0.122783 Apr 11 14:03:45.362937 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 475/943] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:45 2022] GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443 => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:46.397224 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c880411c-06a4-42de-9bed-bf3a237adec8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:46.398139 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c880411c-06a4-42de-9bed-bf3a237adec8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:46.408774 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c880411c-06a4-42de-9bed-bf3a237adec8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:46.409508 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c880411c-06a4-42de-9bed-bf3a237adec8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:46.410481 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c880411c-06a4-42de-9bed-bf3a237adec8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:46.410924 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c880411c-06a4-42de-9bed-bf3a237adec8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:46.607983 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-a20892ac-e4ee-4393-9d09-5a6728e0ecb6 req-6ed94078-e68f-4403-b01f-41da13a0b2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90e1dc70-4ec6-43ef-95f1-8c8d30e26443", "tag": "0cfac28c-91c3-4684-b5c0-10ac64e8d3c8"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:46.620133 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-a20892ac-e4ee-4393-9d09-5a6728e0ecb6 req-6ed94078-e68f-4403-b01f-41da13a0b2fc service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:46.620671 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-a20892ac-e4ee-4393-9d09-5a6728e0ecb6 req-6ed94078-e68f-4403-b01f-41da13a0b2fc service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:46.638260 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c880411c-06a4-42de-9bed-bf3a237adec8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:46.642526 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-a20892ac-e4ee-4393-9d09-5a6728e0ecb6 req-6ed94078-e68f-4403-b01f-41da13a0b2fc service nova] Creating event network-changed:0cfac28c-91c3-4684-b5c0-10ac64e8d3c8 for instance 90e1dc70-4ec6-43ef-95f1-8c8d30e26443 on hv-cinder-83078 Apr 11 14:03:46.648333 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-a20892ac-e4ee-4393-9d09-5a6728e0ecb6 req-6ed94078-e68f-4403-b01f-41da13a0b2fc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045651 Apr 11 14:03:46.649578 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 476/944] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:46.650058 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c880411c-06a4-42de-9bed-bf3a237adec8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443" status: 200 len: 1313 microversion: 2.1 time: 0.272844 Apr 11 14:03:46.650850 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 469/945] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:46 2022] GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:47.668264 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-117775b0-4031-4e7b-acc6-967907a591a8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:47.668988 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-117775b0-4031-4e7b-acc6-967907a591a8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:47.675231 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-117775b0-4031-4e7b-acc6-967907a591a8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:47.675803 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-117775b0-4031-4e7b-acc6-967907a591a8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:47.676653 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-117775b0-4031-4e7b-acc6-967907a591a8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:47.677166 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-117775b0-4031-4e7b-acc6-967907a591a8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:47.946961 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-117775b0-4031-4e7b-acc6-967907a591a8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:47.964135 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-117775b0-4031-4e7b-acc6-967907a591a8 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443" status: 200 len: 1313 microversion: 2.1 time: 0.298474 Apr 11 14:03:47.964987 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 477/946] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:47 2022] GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:48.980924 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f50e93fd-ffa8-44a5-8453-9aea8d5d8eed tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:48.981728 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f50e93fd-ffa8-44a5-8453-9aea8d5d8eed tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:48.989713 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f50e93fd-ffa8-44a5-8453-9aea8d5d8eed tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:48.990175 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f50e93fd-ffa8-44a5-8453-9aea8d5d8eed tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:48.990962 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f50e93fd-ffa8-44a5-8453-9aea8d5d8eed tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:48.991404 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f50e93fd-ffa8-44a5-8453-9aea8d5d8eed tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:49.131831 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f50e93fd-ffa8-44a5-8453-9aea8d5d8eed tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:49.140136 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f50e93fd-ffa8-44a5-8453-9aea8d5d8eed tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443" status: 200 len: 1313 microversion: 2.1 time: 0.163091 Apr 11 14:03:49.141024 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 470/947] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:48 2022] GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:50.157502 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-569e3b92-ed4e-4d32-9542-1be6bdf9326a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:50.158125 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-569e3b92-ed4e-4d32-9542-1be6bdf9326a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:50.164398 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-569e3b92-ed4e-4d32-9542-1be6bdf9326a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:50.164850 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-569e3b92-ed4e-4d32-9542-1be6bdf9326a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:50.165617 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-569e3b92-ed4e-4d32-9542-1be6bdf9326a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:50.166051 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-569e3b92-ed4e-4d32-9542-1be6bdf9326a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:50.296663 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-569e3b92-ed4e-4d32-9542-1be6bdf9326a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:50.304294 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-569e3b92-ed4e-4d32-9542-1be6bdf9326a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443" status: 200 len: 1313 microversion: 2.1 time: 0.150831 Apr 11 14:03:50.305111 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 478/948] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:50 2022] GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:50.804877 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-74437c5d-6ca1-4314-a3a2-5bb924245b8e req-11dd5e9a-26c5-4831-bf27-f3d14f0f78d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90e1dc70-4ec6-43ef-95f1-8c8d30e26443", "name": "network-vif-plugged", "status": "completed", "tag": "0cfac28c-91c3-4684-b5c0-10ac64e8d3c8"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:50.813525 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-74437c5d-6ca1-4314-a3a2-5bb924245b8e req-11dd5e9a-26c5-4831-bf27-f3d14f0f78d4 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:50.814230 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-74437c5d-6ca1-4314-a3a2-5bb924245b8e req-11dd5e9a-26c5-4831-bf27-f3d14f0f78d4 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:50.825665 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-74437c5d-6ca1-4314-a3a2-5bb924245b8e req-11dd5e9a-26c5-4831-bf27-f3d14f0f78d4 service nova] Creating event network-vif-plugged:0cfac28c-91c3-4684-b5c0-10ac64e8d3c8 for instance 90e1dc70-4ec6-43ef-95f1-8c8d30e26443 on hv-cinder-83078 Apr 11 14:03:50.831424 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-74437c5d-6ca1-4314-a3a2-5bb924245b8e req-11dd5e9a-26c5-4831-bf27-f3d14f0f78d4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030215 Apr 11 14:03:50.832159 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 471/949] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:51.321515 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3da13120-d4f5-478a-b672-a651f9fa6d7e tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:51.322038 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3da13120-d4f5-478a-b672-a651f9fa6d7e tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:51.329010 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3da13120-d4f5-478a-b672-a651f9fa6d7e tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:51.329452 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3da13120-d4f5-478a-b672-a651f9fa6d7e tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:51.330207 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3da13120-d4f5-478a-b672-a651f9fa6d7e tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:51.330638 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3da13120-d4f5-478a-b672-a651f9fa6d7e tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:51.459368 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-3da13120-d4f5-478a-b672-a651f9fa6d7e tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:51.466520 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3da13120-d4f5-478a-b672-a651f9fa6d7e tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443" status: 200 len: 1313 microversion: 2.1 time: 0.148945 Apr 11 14:03:51.467239 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 479/950] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:51 2022] GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:52.484537 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0b43aad8-286b-44d5-9271-d9ff4b68e398 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:52.485241 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0b43aad8-286b-44d5-9271-d9ff4b68e398 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:52.491268 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0b43aad8-286b-44d5-9271-d9ff4b68e398 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:52.491755 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0b43aad8-286b-44d5-9271-d9ff4b68e398 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:52.492529 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0b43aad8-286b-44d5-9271-d9ff4b68e398 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:52.492967 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0b43aad8-286b-44d5-9271-d9ff4b68e398 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:52.620248 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0b43aad8-286b-44d5-9271-d9ff4b68e398 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:52.628517 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0b43aad8-286b-44d5-9271-d9ff4b68e398 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443" status: 200 len: 1495 microversion: 2.1 time: 0.148713 Apr 11 14:03:52.629100 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 472/951] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:52 2022] GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443 => generated 1495 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:52.999251 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-67251532-b47f-45bd-a177-fed317dad291 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:52.999813 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-67251532-b47f-45bd-a177-fed317dad291 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:53.006157 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67251532-b47f-45bd-a177-fed317dad291 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:53.006611 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67251532-b47f-45bd-a177-fed317dad291 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:53.007386 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67251532-b47f-45bd-a177-fed317dad291 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:53.007863 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67251532-b47f-45bd-a177-fed317dad291 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:53.033605 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-67251532-b47f-45bd-a177-fed317dad291 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:03:53.104874 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-67251532-b47f-45bd-a177-fed317dad291 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "DELETE /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443" status: 204 len: 0 microversion: 2.1 time: 0.109509 Apr 11 14:03:53.105742 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 480/952] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:03:52 2022] DELETE /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:03:53.113919 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-35cc6f50-7e2f-45cc-9bf2-bd8339366694 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:53.114663 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-35cc6f50-7e2f-45cc-9bf2-bd8339366694 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:53.120581 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35cc6f50-7e2f-45cc-9bf2-bd8339366694 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:53.121035 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35cc6f50-7e2f-45cc-9bf2-bd8339366694 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:53.121793 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35cc6f50-7e2f-45cc-9bf2-bd8339366694 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:53.122229 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35cc6f50-7e2f-45cc-9bf2-bd8339366694 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:53.252038 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-35cc6f50-7e2f-45cc-9bf2-bd8339366694 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:53.259237 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-35cc6f50-7e2f-45cc-9bf2-bd8339366694 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443" status: 200 len: 1501 microversion: 2.1 time: 0.149159 Apr 11 14:03:53.259823 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 473/953] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:53 2022] GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443 => generated 1501 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:54.277836 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4ccfb0e4-518e-4c57-95cd-fd479a4c3d8c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:54.278546 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4ccfb0e4-518e-4c57-95cd-fd479a4c3d8c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:54.285539 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ccfb0e4-518e-4c57-95cd-fd479a4c3d8c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:54.285991 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ccfb0e4-518e-4c57-95cd-fd479a4c3d8c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:54.286762 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ccfb0e4-518e-4c57-95cd-fd479a4c3d8c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:54.287207 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ccfb0e4-518e-4c57-95cd-fd479a4c3d8c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:54.414290 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4ccfb0e4-518e-4c57-95cd-fd479a4c3d8c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:54.421808 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4ccfb0e4-518e-4c57-95cd-fd479a4c3d8c tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443" status: 200 len: 1501 microversion: 2.1 time: 0.148286 Apr 11 14:03:54.422383 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 481/954] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:54 2022] GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443 => generated 1501 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:54.910139 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-7ee978a7-ae68-41f6-8491-f05f85b10705 req-3af4067f-5533-4d0a-9a2a-3db1f9a1c700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90e1dc70-4ec6-43ef-95f1-8c8d30e26443", "name": "network-vif-deleted", "tag": "0cfac28c-91c3-4684-b5c0-10ac64e8d3c8"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:54.918927 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-7ee978a7-ae68-41f6-8491-f05f85b10705 req-3af4067f-5533-4d0a-9a2a-3db1f9a1c700 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:54.919369 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-7ee978a7-ae68-41f6-8491-f05f85b10705 req-3af4067f-5533-4d0a-9a2a-3db1f9a1c700 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:54.931092 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-7ee978a7-ae68-41f6-8491-f05f85b10705 req-3af4067f-5533-4d0a-9a2a-3db1f9a1c700 service nova] Creating event network-vif-deleted:0cfac28c-91c3-4684-b5c0-10ac64e8d3c8 for instance 90e1dc70-4ec6-43ef-95f1-8c8d30e26443 on hv-cinder-83078 Apr 11 14:03:54.936643 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-7ee978a7-ae68-41f6-8491-f05f85b10705 req-3af4067f-5533-4d0a-9a2a-3db1f9a1c700 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030147 Apr 11 14:03:54.937250 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 474/955] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:55.439357 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9ea40482-0005-4c54-a952-c4a51bfb6fe1 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:55.440020 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9ea40482-0005-4c54-a952-c4a51bfb6fe1 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: 90e1dc70-4ec6-43ef-95f1-8c8d30e26443] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:55.446298 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ea40482-0005-4c54-a952-c4a51bfb6fe1 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:55.446752 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ea40482-0005-4c54-a952-c4a51bfb6fe1 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:55.447528 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ea40482-0005-4c54-a952-c4a51bfb6fe1 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:55.447992 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ea40482-0005-4c54-a952-c4a51bfb6fe1 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:55.460780 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-9ea40482-0005-4c54-a952-c4a51bfb6fe1 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] HTTP exception thrown: Instance 90e1dc70-4ec6-43ef-95f1-8c8d30e26443 could not be found. Apr 11 14:03:55.461366 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9ea40482-0005-4c54-a952-c4a51bfb6fe1 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Returning 404 to user: Instance 90e1dc70-4ec6-43ef-95f1-8c8d30e26443 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:03:55.462184 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9ea40482-0005-4c54-a952-c4a51bfb6fe1 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443" status: 404 len: 111 microversion: 2.1 time: 0.027362 Apr 11 14:03:55.462715 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 482/956] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:55 2022] GET /compute/v2.1/servers/90e1dc70-4ec6-43ef-95f1-8c8d30e26443 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:03:55.557372 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-393813163", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "networks": [{"uuid": "a46eb48f-c97d-43d9-b020-3606da009c33"}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:55.606789 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] validate_networks() for [('a46eb48f-c97d-43d9-b020-3606da009c33', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 14:03:55.943597 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 14:03:55.944190 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 14:03:55.944537 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 14:03:55.944945 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 14:03:55.945356 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 14:03:55.954762 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:55.955211 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:55.956055 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:55.956494 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:55.972587 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Getting quotas for project 7ea539d2e309403ab7ea0c5244a6d80f. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:03:55.976433 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Getting quotas for user b469e5f0479349c9bf61af6b1774583b and project 7ea539d2e309403ab7ea0c5244a6d80f. Resources: {'ram', 'instances', 'cores'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:03:55.987713 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 14:03:55.990024 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 14:03:56.037192 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-72bb016c-ddf5-4e27-961a-a80d7c7ddfc7 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.484031 Apr 11 14:03:56.038269 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 475/957] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 14:03:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 14:03:56.047934 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-09d9e81a-1bc9-4988-ac58-74c1aca229bc tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:56.048556 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-09d9e81a-1bc9-4988-ac58-74c1aca229bc tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:56.100046 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-09d9e81a-1bc9-4988-ac58-74c1aca229bc tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:56.106558 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-09d9e81a-1bc9-4988-ac58-74c1aca229bc tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2" status: 200 len: 1213 microversion: 2.1 time: 0.062689 Apr 11 14:03:56.107137 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 483/958] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:56 2022] GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:57.124374 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0138918b-34d1-4fa3-85a9-aebf7654a7fc tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:57.125190 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0138918b-34d1-4fa3-85a9-aebf7654a7fc tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:57.131302 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0138918b-34d1-4fa3-85a9-aebf7654a7fc tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:57.131777 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0138918b-34d1-4fa3-85a9-aebf7654a7fc tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:57.132547 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0138918b-34d1-4fa3-85a9-aebf7654a7fc tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:57.132993 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0138918b-34d1-4fa3-85a9-aebf7654a7fc tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:57.195141 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0138918b-34d1-4fa3-85a9-aebf7654a7fc tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:57.202492 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0138918b-34d1-4fa3-85a9-aebf7654a7fc tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2" status: 200 len: 1271 microversion: 2.1 time: 0.082944 Apr 11 14:03:57.203064 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 476/959] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:57 2022] GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:58.146505 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-494177d4-037d-4389-af26-b1dd225a57f7 req-13329aef-9700-4ebb-86bd-095313509102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa06979f-4ee0-4a16-a07b-a91d20a7b4f2", "tag": "7ca06d09-6253-4a4e-aafe-537a931076f0"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:03:58.157539 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-494177d4-037d-4389-af26-b1dd225a57f7 req-13329aef-9700-4ebb-86bd-095313509102 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:58.158383 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-494177d4-037d-4389-af26-b1dd225a57f7 req-13329aef-9700-4ebb-86bd-095313509102 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:58.178028 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-494177d4-037d-4389-af26-b1dd225a57f7 req-13329aef-9700-4ebb-86bd-095313509102 service nova] Creating event network-changed:7ca06d09-6253-4a4e-aafe-537a931076f0 for instance fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 on hv-cinder-83078 Apr 11 14:03:58.185197 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-494177d4-037d-4389-af26-b1dd225a57f7 req-13329aef-9700-4ebb-86bd-095313509102 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042467 Apr 11 14:03:58.185809 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 484/960] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:03:58.220079 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b0901461-80ab-4fca-92b7-5a60224cb13d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:58.220830 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b0901461-80ab-4fca-92b7-5a60224cb13d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:58.227813 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b0901461-80ab-4fca-92b7-5a60224cb13d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:58.228440 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b0901461-80ab-4fca-92b7-5a60224cb13d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:58.229326 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b0901461-80ab-4fca-92b7-5a60224cb13d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:58.229897 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b0901461-80ab-4fca-92b7-5a60224cb13d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:58.360719 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b0901461-80ab-4fca-92b7-5a60224cb13d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:58.367984 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b0901461-80ab-4fca-92b7-5a60224cb13d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2" status: 200 len: 1313 microversion: 2.1 time: 0.152508 Apr 11 14:03:58.368559 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 477/961] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:58 2022] GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:03:59.386269 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1ee4daaa-95c1-4d94-975f-cc172c3987f6 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:03:59.386962 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1ee4daaa-95c1-4d94-975f-cc172c3987f6 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:03:59.394177 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ee4daaa-95c1-4d94-975f-cc172c3987f6 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:59.394623 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ee4daaa-95c1-4d94-975f-cc172c3987f6 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:59.395390 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ee4daaa-95c1-4d94-975f-cc172c3987f6 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:03:59.395849 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ee4daaa-95c1-4d94-975f-cc172c3987f6 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:03:59.535265 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1ee4daaa-95c1-4d94-975f-cc172c3987f6 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:03:59.543913 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1ee4daaa-95c1-4d94-975f-cc172c3987f6 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2" status: 200 len: 1313 microversion: 2.1 time: 0.162247 Apr 11 14:03:59.544551 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 485/962] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:03:59 2022] GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:00.561511 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e6a3fb7f-07fa-4409-b146-27173befbbd0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:00.562123 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e6a3fb7f-07fa-4409-b146-27173befbbd0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:00.568565 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e6a3fb7f-07fa-4409-b146-27173befbbd0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:00.569009 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e6a3fb7f-07fa-4409-b146-27173befbbd0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:00.569764 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e6a3fb7f-07fa-4409-b146-27173befbbd0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:00.570196 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e6a3fb7f-07fa-4409-b146-27173befbbd0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:00.698448 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e6a3fb7f-07fa-4409-b146-27173befbbd0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:00.705917 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e6a3fb7f-07fa-4409-b146-27173befbbd0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2" status: 200 len: 1313 microversion: 2.1 time: 0.148824 Apr 11 14:04:00.706496 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 478/963] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:00 2022] GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:01.722541 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d67d491c-21e8-4ed6-9636-061ee2696d5a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:01.723160 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d67d491c-21e8-4ed6-9636-061ee2696d5a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:01.729450 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d67d491c-21e8-4ed6-9636-061ee2696d5a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:01.729906 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d67d491c-21e8-4ed6-9636-061ee2696d5a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:01.730705 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d67d491c-21e8-4ed6-9636-061ee2696d5a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:01.731145 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d67d491c-21e8-4ed6-9636-061ee2696d5a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:01.861660 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d67d491c-21e8-4ed6-9636-061ee2696d5a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:01.868868 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d67d491c-21e8-4ed6-9636-061ee2696d5a tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2" status: 200 len: 1313 microversion: 2.1 time: 0.150183 Apr 11 14:04:01.869442 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 486/964] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:01 2022] GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:02.859394 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-f3039680-8315-4b7d-8796-7c1f9a981587 req-bdd87dbd-61f4-41b6-8e85-36c18fd8cd60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa06979f-4ee0-4a16-a07b-a91d20a7b4f2", "name": "network-vif-plugged", "status": "completed", "tag": "7ca06d09-6253-4a4e-aafe-537a931076f0"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:02.868957 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-f3039680-8315-4b7d-8796-7c1f9a981587 req-bdd87dbd-61f4-41b6-8e85-36c18fd8cd60 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:02.869410 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-f3039680-8315-4b7d-8796-7c1f9a981587 req-bdd87dbd-61f4-41b6-8e85-36c18fd8cd60 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:02.880754 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-f3039680-8315-4b7d-8796-7c1f9a981587 req-bdd87dbd-61f4-41b6-8e85-36c18fd8cd60 service nova] Creating event network-vif-plugged:7ca06d09-6253-4a4e-aafe-537a931076f0 for instance fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 on hv-cinder-83078 Apr 11 14:04:02.885586 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-f3039680-8315-4b7d-8796-7c1f9a981587 req-bdd87dbd-61f4-41b6-8e85-36c18fd8cd60 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029945 Apr 11 14:04:02.886361 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 479/965] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:04:02.887202 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-85dda389-055c-4d93-b1ac-79b01b75e416 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:02.888357 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-85dda389-055c-4d93-b1ac-79b01b75e416 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:02.895751 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-85dda389-055c-4d93-b1ac-79b01b75e416 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:02.896067 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-85dda389-055c-4d93-b1ac-79b01b75e416 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:02.897011 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-85dda389-055c-4d93-b1ac-79b01b75e416 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:02.897447 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-85dda389-055c-4d93-b1ac-79b01b75e416 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:03.062151 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-85dda389-055c-4d93-b1ac-79b01b75e416 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:03.069527 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-85dda389-055c-4d93-b1ac-79b01b75e416 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2" status: 200 len: 1313 microversion: 2.1 time: 0.187013 Apr 11 14:04:03.070140 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 487/966] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:02 2022] GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:04:04.087809 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bbf75b80-8e38-4b52-988d-9937a043d68f tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:04.089431 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bbf75b80-8e38-4b52-988d-9937a043d68f tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:04.096366 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbf75b80-8e38-4b52-988d-9937a043d68f tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:04.096815 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbf75b80-8e38-4b52-988d-9937a043d68f tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:04.097592 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbf75b80-8e38-4b52-988d-9937a043d68f tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:04.098031 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbf75b80-8e38-4b52-988d-9937a043d68f tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:04.227788 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-bbf75b80-8e38-4b52-988d-9937a043d68f tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:04.235227 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bbf75b80-8e38-4b52-988d-9937a043d68f tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2" status: 200 len: 1313 microversion: 2.1 time: 0.152294 Apr 11 14:04:04.235827 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 480/967] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:04 2022] GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:05.251906 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-559b0868-76c5-4a01-a4dc-6db5b14ee831 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:05.252551 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-559b0868-76c5-4a01-a4dc-6db5b14ee831 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:05.258829 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-559b0868-76c5-4a01-a4dc-6db5b14ee831 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:05.259282 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-559b0868-76c5-4a01-a4dc-6db5b14ee831 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:05.260072 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-559b0868-76c5-4a01-a4dc-6db5b14ee831 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:05.260502 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-559b0868-76c5-4a01-a4dc-6db5b14ee831 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:05.384912 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-559b0868-76c5-4a01-a4dc-6db5b14ee831 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:05.392550 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-559b0868-76c5-4a01-a4dc-6db5b14ee831 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2" status: 200 len: 1496 microversion: 2.1 time: 0.144540 Apr 11 14:04:05.393378 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 488/968] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:05 2022] GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 => generated 1496 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:05.804025 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-dc10af07-8edc-4766-9e5e-56c3c775ba8d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:05.804511 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-dc10af07-8edc-4766-9e5e-56c3c775ba8d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:05.811053 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dc10af07-8edc-4766-9e5e-56c3c775ba8d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:05.811513 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dc10af07-8edc-4766-9e5e-56c3c775ba8d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:05.812319 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dc10af07-8edc-4766-9e5e-56c3c775ba8d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:05.812787 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dc10af07-8edc-4766-9e5e-56c3c775ba8d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:05.836512 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-dc10af07-8edc-4766-9e5e-56c3c775ba8d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:04:05.908361 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-dc10af07-8edc-4766-9e5e-56c3c775ba8d tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2" status: 204 len: 0 microversion: 2.1 time: 0.108003 Apr 11 14:04:05.909009 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 481/969] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:04:05 2022] DELETE /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:04:05.917365 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-222d61e8-b72f-4e57-bd5f-80b0bb87bfc0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:05.917982 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-222d61e8-b72f-4e57-bd5f-80b0bb87bfc0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:05.923761 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-222d61e8-b72f-4e57-bd5f-80b0bb87bfc0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:05.924213 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-222d61e8-b72f-4e57-bd5f-80b0bb87bfc0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:05.924973 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-222d61e8-b72f-4e57-bd5f-80b0bb87bfc0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:05.925407 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-222d61e8-b72f-4e57-bd5f-80b0bb87bfc0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:06.052681 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-222d61e8-b72f-4e57-bd5f-80b0bb87bfc0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:06.060811 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-222d61e8-b72f-4e57-bd5f-80b0bb87bfc0 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2" status: 200 len: 1502 microversion: 2.1 time: 0.146915 Apr 11 14:04:06.061325 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 489/970] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:05 2022] GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:04:06.988876 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f7e327cb-7294-4bb2-a8ad-c19ebb914b98 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:06.989455 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f7e327cb-7294-4bb2-a8ad-c19ebb914b98 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:06.995708 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7e327cb-7294-4bb2-a8ad-c19ebb914b98 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:06.996126 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7e327cb-7294-4bb2-a8ad-c19ebb914b98 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:06.996994 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7e327cb-7294-4bb2-a8ad-c19ebb914b98 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:06.997460 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7e327cb-7294-4bb2-a8ad-c19ebb914b98 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:07.020214 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f7e327cb-7294-4bb2-a8ad-c19ebb914b98 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/ips" status: 200 len: 149 microversion: 2.1 time: 0.035527 Apr 11 14:04:07.020798 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 482/971] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Apr 11 14:04:06 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:04:07.078591 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-61c238d0-6633-4e36-9a89-630d9877adbb tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:07.079507 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-61c238d0-6633-4e36-9a89-630d9877adbb tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:07.089863 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-61c238d0-6633-4e36-9a89-630d9877adbb tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:07.091316 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-61c238d0-6633-4e36-9a89-630d9877adbb tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:07.092948 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-61c238d0-6633-4e36-9a89-630d9877adbb tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:07.093871 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-61c238d0-6633-4e36-9a89-630d9877adbb tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:07.298289 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-61c238d0-6633-4e36-9a89-630d9877adbb tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469e5f0479349c9bf61af6b1774583b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea539d2e309403ab7ea0c5244a6d80f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:07.306048 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-61c238d0-6633-4e36-9a89-630d9877adbb tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2" status: 200 len: 1502 microversion: 2.1 time: 0.232493 Apr 11 14:04:07.307214 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 490/972] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:07 2022] GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:07.683606 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-b66a3b36-53a1-46aa-8a54-249d88e40e28 req-b40046a9-648b-4f35-aba8-ad63c64cd38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa06979f-4ee0-4a16-a07b-a91d20a7b4f2", "name": "network-vif-deleted", "tag": "7ca06d09-6253-4a4e-aafe-537a931076f0"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:07.692975 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-b66a3b36-53a1-46aa-8a54-249d88e40e28 req-b40046a9-648b-4f35-aba8-ad63c64cd38e service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:07.693497 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-b66a3b36-53a1-46aa-8a54-249d88e40e28 req-b40046a9-648b-4f35-aba8-ad63c64cd38e service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:07.707894 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-b66a3b36-53a1-46aa-8a54-249d88e40e28 req-b40046a9-648b-4f35-aba8-ad63c64cd38e service nova] Creating event network-vif-deleted:7ca06d09-6253-4a4e-aafe-537a931076f0 for instance fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 on hv-cinder-83078 Apr 11 14:04:07.712687 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-b66a3b36-53a1-46aa-8a54-249d88e40e28 req-b40046a9-648b-4f35-aba8-ad63c64cd38e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032709 Apr 11 14:04:07.713284 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 483/973] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:04:08.324591 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8c18f50e-9762-41ff-a98a-594b8bd7fad3 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:08.325563 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8c18f50e-9762-41ff-a98a-594b8bd7fad3 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] [instance: fa06979f-4ee0-4a16-a07b-a91d20a7b4f2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:08.332086 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8c18f50e-9762-41ff-a98a-594b8bd7fad3 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:08.332634 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8c18f50e-9762-41ff-a98a-594b8bd7fad3 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:08.333570 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8c18f50e-9762-41ff-a98a-594b8bd7fad3 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:08.334050 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8c18f50e-9762-41ff-a98a-594b8bd7fad3 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:08.338002 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-df9031fc-0516-447a-a62a-886d1107fa86 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9042d567-5dc8-4c1c-a178-a41ff084c02b"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:08.339146 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-df9031fc-0516-447a-a62a-886d1107fa86 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:08.345680 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df9031fc-0516-447a-a62a-886d1107fa86 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:08.346136 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df9031fc-0516-447a-a62a-886d1107fa86 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:08.346905 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df9031fc-0516-447a-a62a-886d1107fa86 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:08.347341 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df9031fc-0516-447a-a62a-886d1107fa86 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:08.348151 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-8c18f50e-9762-41ff-a98a-594b8bd7fad3 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] HTTP exception thrown: Instance fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 could not be found. Apr 11 14:04:08.348752 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8c18f50e-9762-41ff-a98a-594b8bd7fad3 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] Returning 404 to user: Instance fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:04:08.349588 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8c18f50e-9762-41ff-a98a-594b8bd7fad3 tempest-VolumesActionsTest-630958389 tempest-VolumesActionsTest-630958389-project] 10.222.0.67 "GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2" status: 404 len: 111 microversion: 2.1 time: 0.029804 Apr 11 14:04:08.350309 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 491/974] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:08 2022] GET /compute/v2.1/servers/fa06979f-4ee0-4a16-a07b-a91d20a7b4f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:04:08.580743 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-df9031fc-0516-447a-a62a-886d1107fa86 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "POST /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247189 Apr 11 14:04:08.581569 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 484/975] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 14:04:08 2022] POST /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:04:15.027682 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-84f1d1e9-9d9a-40ac-8317-44cd440791f2 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9042d567-5dc8-4c1c-a178-a41ff084c02b"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:15.030296 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-84f1d1e9-9d9a-40ac-8317-44cd440791f2 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:15.036952 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-84f1d1e9-9d9a-40ac-8317-44cd440791f2 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:15.037434 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-84f1d1e9-9d9a-40ac-8317-44cd440791f2 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:15.038450 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-84f1d1e9-9d9a-40ac-8317-44cd440791f2 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:15.039085 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-84f1d1e9-9d9a-40ac-8317-44cd440791f2 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:15.121762 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-84f1d1e9-9d9a-40ac-8317-44cd440791f2 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Invalid volume: volume 9042d567-5dc8-4c1c-a178-a41ff084c02b is already attached to instances: e427eb53-7ff8-42d2-a90e-b07c69fc0a86 Apr 11 14:04:15.122389 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-84f1d1e9-9d9a-40ac-8317-44cd440791f2 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 400 to user: Invalid volume: volume 9042d567-5dc8-4c1c-a178-a41ff084c02b is already attached to instances: e427eb53-7ff8-42d2-a90e-b07c69fc0a86 {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:04:15.123367 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-84f1d1e9-9d9a-40ac-8317-44cd440791f2 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "POST /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099818 Apr 11 14:04:15.124263 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 492/976] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 14:04:15 2022] POST /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 14:04:15.187804 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4defd7fc-09bd-4cb0-86d0-ba068cc8cf52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:15.189247 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4defd7fc-09bd-4cb0-86d0-ba068cc8cf52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:15.198663 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4defd7fc-09bd-4cb0-86d0-ba068cc8cf52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:15.199406 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4defd7fc-09bd-4cb0-86d0-ba068cc8cf52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:15.200462 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4defd7fc-09bd-4cb0-86d0-ba068cc8cf52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:15.201169 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4defd7fc-09bd-4cb0-86d0-ba068cc8cf52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:15.284136 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-4defd7fc-09bd-4cb0-86d0-ba068cc8cf52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lazy-loading 'services' on Instance uuid e427eb53-7ff8-42d2-a90e-b07c69fc0a86 {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:04:15.361527 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4defd7fc-09bd-4cb0-86d0-ba068cc8cf52 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/os-volume_attachments/9042d567-5dc8-4c1c-a178-a41ff084c02b" status: 202 len: 0 microversion: 2.1 time: 0.177788 Apr 11 14:04:15.362130 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 485/977] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Apr 11 14:04:15 2022] DELETE /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/os-volume_attachments/9042d567-5dc8-4c1c-a178-a41ff084c02b => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:04:15.371022 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-49c263de-6616-4759-a848-9b77bcf0765a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:15.372361 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-49c263de-6616-4759-a848-9b77bcf0765a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:15.383779 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-49c263de-6616-4759-a848-9b77bcf0765a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:15.384700 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-49c263de-6616-4759-a848-9b77bcf0765a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:15.385836 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-49c263de-6616-4759-a848-9b77bcf0765a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:15.386374 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-49c263de-6616-4759-a848-9b77bcf0765a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:15.431113 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-49c263de-6616-4759-a848-9b77bcf0765a tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064148 Apr 11 14:04:15.431700 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 493/978] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:04:15 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:04:16.443030 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-03c6f286-4726-4290-9f7f-934c696b844e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:16.444163 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-03c6f286-4726-4290-9f7f-934c696b844e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:16.452233 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-03c6f286-4726-4290-9f7f-934c696b844e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:16.453490 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-03c6f286-4726-4290-9f7f-934c696b844e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:16.454887 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-03c6f286-4726-4290-9f7f-934c696b844e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:16.455536 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-03c6f286-4726-4290-9f7f-934c696b844e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:16.486520 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-03c6f286-4726-4290-9f7f-934c696b844e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047721 Apr 11 14:04:16.487674 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 486/979] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:04:16 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 14:04:16.548459 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-64c69d8b-191e-473f-ba26-f4757efb7136 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:16.548992 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-64c69d8b-191e-473f-ba26-f4757efb7136 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:16.556075 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64c69d8b-191e-473f-ba26-f4757efb7136 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:16.556608 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64c69d8b-191e-473f-ba26-f4757efb7136 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:16.557453 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64c69d8b-191e-473f-ba26-f4757efb7136 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:16.557995 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64c69d8b-191e-473f-ba26-f4757efb7136 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:16.582825 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-64c69d8b-191e-473f-ba26-f4757efb7136 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:04:16.685661 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-64c69d8b-191e-473f-ba26-f4757efb7136 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 204 len: 0 microversion: 2.1 time: 0.140620 Apr 11 14:04:16.689634 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 494/980] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:04:16 2022] DELETE /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:04:16.695593 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-63db0c2d-06a7-4021-9b3e-61d9de3cb678 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:16.696623 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-63db0c2d-06a7-4021-9b3e-61d9de3cb678 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:16.704837 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63db0c2d-06a7-4021-9b3e-61d9de3cb678 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:16.705796 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63db0c2d-06a7-4021-9b3e-61d9de3cb678 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:16.706843 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63db0c2d-06a7-4021-9b3e-61d9de3cb678 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:16.707539 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63db0c2d-06a7-4021-9b3e-61d9de3cb678 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:16.879214 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-63db0c2d-06a7-4021-9b3e-61d9de3cb678 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:16.890865 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-63db0c2d-06a7-4021-9b3e-61d9de3cb678 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 200 len: 1680 microversion: 2.1 time: 0.199564 Apr 11 14:04:16.891452 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 487/981] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:16 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:17.915174 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ab60b23f-fa9f-4186-b6d3-a0949d57ae67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:17.916198 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ab60b23f-fa9f-4186-b6d3-a0949d57ae67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:17.922976 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab60b23f-fa9f-4186-b6d3-a0949d57ae67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:17.923728 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab60b23f-fa9f-4186-b6d3-a0949d57ae67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:17.925303 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab60b23f-fa9f-4186-b6d3-a0949d57ae67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:17.926355 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab60b23f-fa9f-4186-b6d3-a0949d57ae67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:18.087080 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ab60b23f-fa9f-4186-b6d3-a0949d57ae67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:18.095997 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ab60b23f-fa9f-4186-b6d3-a0949d57ae67 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 200 len: 1680 microversion: 2.1 time: 0.186852 Apr 11 14:04:18.099678 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 495/982] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:17 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:19.114289 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0c616118-b855-4c43-9705-c82b079e1023 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:19.114941 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0c616118-b855-4c43-9705-c82b079e1023 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:19.122464 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c616118-b855-4c43-9705-c82b079e1023 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:19.123474 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c616118-b855-4c43-9705-c82b079e1023 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:19.124625 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c616118-b855-4c43-9705-c82b079e1023 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:19.125158 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c616118-b855-4c43-9705-c82b079e1023 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:19.203095 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0c616118-b855-4c43-9705-c82b079e1023 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:19.211839 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0c616118-b855-4c43-9705-c82b079e1023 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 200 len: 1613 microversion: 2.1 time: 0.100736 Apr 11 14:04:19.222745 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 488/983] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:19 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 1613 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:19.287920 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-0c199cbd-0280-4147-ab87-0be27183a76d req-ddb8bc66-6bd2-4d1d-9453-edf8217d1a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e427eb53-7ff8-42d2-a90e-b07c69fc0a86", "name": "network-vif-deleted", "tag": "439feed1-351c-4939-9798-5d72e310c897"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:19.309481 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-0c199cbd-0280-4147-ab87-0be27183a76d req-ddb8bc66-6bd2-4d1d-9453-edf8217d1a1b service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:19.312366 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-0c199cbd-0280-4147-ab87-0be27183a76d req-ddb8bc66-6bd2-4d1d-9453-edf8217d1a1b service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:19.336672 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-0c199cbd-0280-4147-ab87-0be27183a76d req-ddb8bc66-6bd2-4d1d-9453-edf8217d1a1b service nova] Creating event network-vif-deleted:439feed1-351c-4939-9798-5d72e310c897 for instance e427eb53-7ff8-42d2-a90e-b07c69fc0a86 on hv-cinder-83078 Apr 11 14:04:19.345444 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-0c199cbd-0280-4147-ab87-0be27183a76d req-ddb8bc66-6bd2-4d1d-9453-edf8217d1a1b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063044 Apr 11 14:04:19.347152 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 496/984] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:04:20.232328 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7ccc0945-f404-433f-ad12-8f76ae320103 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:20.234294 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7ccc0945-f404-433f-ad12-8f76ae320103 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:20.242513 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ccc0945-f404-433f-ad12-8f76ae320103 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:20.243054 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ccc0945-f404-433f-ad12-8f76ae320103 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:20.243931 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ccc0945-f404-433f-ad12-8f76ae320103 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:20.249737 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ccc0945-f404-433f-ad12-8f76ae320103 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:20.267182 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-7ccc0945-f404-433f-ad12-8f76ae320103 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Instance e427eb53-7ff8-42d2-a90e-b07c69fc0a86 could not be found. Apr 11 14:04:20.267823 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7ccc0945-f404-433f-ad12-8f76ae320103 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 404 to user: Instance e427eb53-7ff8-42d2-a90e-b07c69fc0a86 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:04:20.268689 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7ccc0945-f404-433f-ad12-8f76ae320103 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 404 len: 111 microversion: 2.1 time: 0.042098 Apr 11 14:04:20.269459 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 489/985] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:20 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:04:20.288300 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f7f993e0-bb84-4b00-b433-8ad74a4e39be tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '.version_select at 0x7f730baf3160>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:20.316952 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f7f993e0-bb84-4b00-b433-8ad74a4e39be tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-314550408" status: 202 len: 0 microversion: 2.1 time: 0.041439 Apr 11 14:04:20.319763 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 497/986] 10.222.0.67 () {58 vars in 1217 bytes} [Mon Apr 11 14:04:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-314550408 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:04:21.050607 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2271aedf-07f2-40c6-a1df-db6286f9b5a7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Action: 'create', calling method: .version_select at 0x7f730693e1f0>, body: {"keypair": {"name": "tempest-keypair-1434969487"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:21.065484 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-2271aedf-07f2-40c6-a1df-db6286f9b5a7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:04:21.070058 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-2271aedf-07f2-40c6-a1df-db6286f9b5a7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for user 2cbcdc40fea745f48e1dfc62a732b7ee and project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:04:21.358267 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-2271aedf-07f2-40c6-a1df-db6286f9b5a7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:04:21.362681 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-2271aedf-07f2-40c6-a1df-db6286f9b5a7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for user 2cbcdc40fea745f48e1dfc62a732b7ee and project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:04:21.383543 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2271aedf-07f2-40c6-a1df-db6286f9b5a7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.336697 Apr 11 14:04:21.384317 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 490/987] 10.222.0.67 () {60 vars in 1157 bytes} [Mon Apr 11 14:04:21 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:22.797433 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1990989730", "imageRef": "ebc2c644-8c8c-4585-8fc1-de60d3918bd2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "730a24f2-5d00-49fb-895d-b884d9163131"}], "security_groups": [{"name": "tempest-securitygroup--1974203633"}], "key_name": "tempest-keypair-1434969487", "user_data": "}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:22.916097 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] validate_networks() for [('730a24f2-5d00-49fb-895d-b884d9163131', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 14:04:23.326574 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 14:04:23.327000 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 14:04:23.327848 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 14:04:23.328401 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 14:04:23.328823 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 14:04:23.338287 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:23.338964 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:23.339831 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:23.340271 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:23.361621 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:04:23.365811 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Getting quotas for user 2cbcdc40fea745f48e1dfc62a732b7ee and project 63cddbab1b664b5a89b56d5632d2f62e. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:04:23.379209 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 14:04:23.381776 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ebc2c644-8c8c-4585-8fc1-de60d3918bd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 14:04:23.445097 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-88a2b51f-4df5-4845-a2d6-ba906f1e750c tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.654522 Apr 11 14:04:23.446241 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 498/988] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 14:04:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 14:04:23.464410 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-76223fca-ac9a-4c91-a5ef-6442c60d7201 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:23.465136 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-76223fca-ac9a-4c91-a5ef-6442c60d7201 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:23.532340 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-76223fca-ac9a-4c91-a5ef-6442c60d7201 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:23.541102 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-76223fca-ac9a-4c91-a5ef-6442c60d7201 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 200 len: 1242 microversion: 2.1 time: 0.080454 Apr 11 14:04:23.541691 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 491/989] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:23 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:24.558867 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d1e50d28-1b09-4c06-96e3-89036c494774 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:24.561612 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d1e50d28-1b09-4c06-96e3-89036c494774 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:24.574837 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d1e50d28-1b09-4c06-96e3-89036c494774 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:24.576348 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d1e50d28-1b09-4c06-96e3-89036c494774 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:24.577320 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d1e50d28-1b09-4c06-96e3-89036c494774 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:24.577910 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d1e50d28-1b09-4c06-96e3-89036c494774 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:24.673291 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d1e50d28-1b09-4c06-96e3-89036c494774 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:24.697995 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d1e50d28-1b09-4c06-96e3-89036c494774 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 200 len: 1312 microversion: 2.1 time: 0.138108 Apr 11 14:04:24.712465 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 499/990] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:24 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:25.725595 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5175ff3f-8667-433e-8cd5-3bd56ecc2622 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:25.727187 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5175ff3f-8667-433e-8cd5-3bd56ecc2622 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:25.741405 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5175ff3f-8667-433e-8cd5-3bd56ecc2622 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:25.742011 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5175ff3f-8667-433e-8cd5-3bd56ecc2622 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:25.743492 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5175ff3f-8667-433e-8cd5-3bd56ecc2622 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:25.748589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5175ff3f-8667-433e-8cd5-3bd56ecc2622 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:25.956396 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5175ff3f-8667-433e-8cd5-3bd56ecc2622 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:25.965613 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5175ff3f-8667-433e-8cd5-3bd56ecc2622 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 200 len: 1368 microversion: 2.1 time: 0.245477 Apr 11 14:04:25.967357 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 492/991] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:25 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:26.124606 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-28e8ad19-d32b-4512-971f-d9fc69cd6b21 req-4be7f817-4a87-4899-b0c6-b8df57f77f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03da3e44-70ae-4f78-96da-9dcf86b4576e", "tag": "991713fa-d7a2-4182-b74a-c6133eec42c5"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:26.133091 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-28e8ad19-d32b-4512-971f-d9fc69cd6b21 req-4be7f817-4a87-4899-b0c6-b8df57f77f95 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:26.137918 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-28e8ad19-d32b-4512-971f-d9fc69cd6b21 req-4be7f817-4a87-4899-b0c6-b8df57f77f95 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:26.154577 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-28e8ad19-d32b-4512-971f-d9fc69cd6b21 req-4be7f817-4a87-4899-b0c6-b8df57f77f95 service nova] Creating event network-changed:991713fa-d7a2-4182-b74a-c6133eec42c5 for instance 03da3e44-70ae-4f78-96da-9dcf86b4576e on hv-cinder-83078 Apr 11 14:04:26.161043 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-28e8ad19-d32b-4512-971f-d9fc69cd6b21 req-4be7f817-4a87-4899-b0c6-b8df57f77f95 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042637 Apr 11 14:04:26.162278 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 500/992] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:04:26.984472 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6eaceab0-8925-45cb-8650-d9535d97e1d1 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:26.985031 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6eaceab0-8925-45cb-8650-d9535d97e1d1 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:26.991873 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6eaceab0-8925-45cb-8650-d9535d97e1d1 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:26.992331 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6eaceab0-8925-45cb-8650-d9535d97e1d1 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:26.993121 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6eaceab0-8925-45cb-8650-d9535d97e1d1 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:26.993567 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6eaceab0-8925-45cb-8650-d9535d97e1d1 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:27.138143 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6eaceab0-8925-45cb-8650-d9535d97e1d1 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:27.146057 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6eaceab0-8925-45cb-8650-d9535d97e1d1 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 200 len: 1368 microversion: 2.1 time: 0.166331 Apr 11 14:04:27.146973 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 493/993] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:26 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:28.166666 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e8aaeec4-df57-4f06-bc35-fde695543a5e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:28.167375 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e8aaeec4-df57-4f06-bc35-fde695543a5e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:28.173936 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e8aaeec4-df57-4f06-bc35-fde695543a5e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:28.174420 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e8aaeec4-df57-4f06-bc35-fde695543a5e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:28.175581 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e8aaeec4-df57-4f06-bc35-fde695543a5e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:28.176173 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e8aaeec4-df57-4f06-bc35-fde695543a5e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:28.308308 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e8aaeec4-df57-4f06-bc35-fde695543a5e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:28.316273 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e8aaeec4-df57-4f06-bc35-fde695543a5e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 200 len: 1368 microversion: 2.1 time: 0.154289 Apr 11 14:04:28.316834 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 501/994] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:28 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:29.332584 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-abf57b8e-76ea-466f-8950-6fd3178bdc02 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:29.333106 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-abf57b8e-76ea-466f-8950-6fd3178bdc02 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:29.339565 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-abf57b8e-76ea-466f-8950-6fd3178bdc02 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:29.340064 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-abf57b8e-76ea-466f-8950-6fd3178bdc02 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:29.341422 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-abf57b8e-76ea-466f-8950-6fd3178bdc02 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:29.341876 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-abf57b8e-76ea-466f-8950-6fd3178bdc02 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:29.471037 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-abf57b8e-76ea-466f-8950-6fd3178bdc02 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:29.478271 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-abf57b8e-76ea-466f-8950-6fd3178bdc02 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 200 len: 1368 microversion: 2.1 time: 0.149651 Apr 11 14:04:29.478844 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 494/995] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:29 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:30.495434 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d80158d7-2375-4300-8892-0041a8e54ad7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:30.496195 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d80158d7-2375-4300-8892-0041a8e54ad7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:30.502595 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d80158d7-2375-4300-8892-0041a8e54ad7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:30.503034 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d80158d7-2375-4300-8892-0041a8e54ad7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:30.503824 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d80158d7-2375-4300-8892-0041a8e54ad7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:30.504253 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d80158d7-2375-4300-8892-0041a8e54ad7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:30.702670 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d80158d7-2375-4300-8892-0041a8e54ad7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:30.713421 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d80158d7-2375-4300-8892-0041a8e54ad7 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 200 len: 1368 microversion: 2.1 time: 0.221781 Apr 11 14:04:30.722679 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 502/996] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:30 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:31.018501 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-245b56c6-d4eb-4619-97df-6905fa80de6b req-c13b61d2-8412-4f60-adea-78faa2b67ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03da3e44-70ae-4f78-96da-9dcf86b4576e", "name": "network-vif-plugged", "status": "completed", "tag": "991713fa-d7a2-4182-b74a-c6133eec42c5"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:31.028102 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-245b56c6-d4eb-4619-97df-6905fa80de6b req-c13b61d2-8412-4f60-adea-78faa2b67ba9 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:31.028549 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-245b56c6-d4eb-4619-97df-6905fa80de6b req-c13b61d2-8412-4f60-adea-78faa2b67ba9 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:31.044560 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-245b56c6-d4eb-4619-97df-6905fa80de6b req-c13b61d2-8412-4f60-adea-78faa2b67ba9 service nova] Creating event network-vif-plugged:991713fa-d7a2-4182-b74a-c6133eec42c5 for instance 03da3e44-70ae-4f78-96da-9dcf86b4576e on hv-cinder-83078 Apr 11 14:04:31.049813 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-245b56c6-d4eb-4619-97df-6905fa80de6b req-c13b61d2-8412-4f60-adea-78faa2b67ba9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035124 Apr 11 14:04:31.050717 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 495/997] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:04:31.729336 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-30ae8ee3-60fa-4fb7-bf8c-757acb732813 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:31.729950 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-30ae8ee3-60fa-4fb7-bf8c-757acb732813 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:31.737124 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-30ae8ee3-60fa-4fb7-bf8c-757acb732813 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:31.737570 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-30ae8ee3-60fa-4fb7-bf8c-757acb732813 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:31.738325 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-30ae8ee3-60fa-4fb7-bf8c-757acb732813 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:31.738753 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-30ae8ee3-60fa-4fb7-bf8c-757acb732813 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:31.863516 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-30ae8ee3-60fa-4fb7-bf8c-757acb732813 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:31.870706 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-30ae8ee3-60fa-4fb7-bf8c-757acb732813 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 200 len: 1368 microversion: 2.1 time: 0.145195 Apr 11 14:04:31.871275 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 503/998] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:31 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:32.888170 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-dfb254cb-67da-4a44-a71e-a32362681871 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:32.889147 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-dfb254cb-67da-4a44-a71e-a32362681871 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:32.895436 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dfb254cb-67da-4a44-a71e-a32362681871 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:32.895926 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dfb254cb-67da-4a44-a71e-a32362681871 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:32.896701 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dfb254cb-67da-4a44-a71e-a32362681871 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:32.897140 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dfb254cb-67da-4a44-a71e-a32362681871 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:33.023138 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-dfb254cb-67da-4a44-a71e-a32362681871 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:33.031071 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-dfb254cb-67da-4a44-a71e-a32362681871 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 200 len: 1558 microversion: 2.1 time: 0.147608 Apr 11 14:04:33.031646 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 496/999] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:32 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:33.047831 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-02f3ad43-8d97-4ffd-bf27-cff8a8fe3217 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:33.048329 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-02f3ad43-8d97-4ffd-bf27-cff8a8fe3217 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:33.054485 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-02f3ad43-8d97-4ffd-bf27-cff8a8fe3217 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:33.054940 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-02f3ad43-8d97-4ffd-bf27-cff8a8fe3217 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:33.055732 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-02f3ad43-8d97-4ffd-bf27-cff8a8fe3217 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:33.056172 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-02f3ad43-8d97-4ffd-bf27-cff8a8fe3217 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:33.129838 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-02f3ad43-8d97-4ffd-bf27-cff8a8fe3217 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086665 Apr 11 14:04:33.130434 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 504/1000] 10.222.0.67 () {58 vars in 1274 bytes} [Mon Apr 11 14:04:33 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:04:34.094247 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-5e791205-7aad-4789-8cc7-9879f5717dda req-234e1858-b8c0-4058-b576-6117e9ed5b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03da3e44-70ae-4f78-96da-9dcf86b4576e", "tag": "991713fa-d7a2-4182-b74a-c6133eec42c5"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:34.103849 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-5e791205-7aad-4789-8cc7-9879f5717dda req-234e1858-b8c0-4058-b576-6117e9ed5b8c service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:34.104304 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-5e791205-7aad-4789-8cc7-9879f5717dda req-234e1858-b8c0-4058-b576-6117e9ed5b8c service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:34.115852 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-5e791205-7aad-4789-8cc7-9879f5717dda req-234e1858-b8c0-4058-b576-6117e9ed5b8c service nova] Creating event network-changed:991713fa-d7a2-4182-b74a-c6133eec42c5 for instance 03da3e44-70ae-4f78-96da-9dcf86b4576e on hv-cinder-83078 Apr 11 14:04:34.120741 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-5e791205-7aad-4789-8cc7-9879f5717dda req-234e1858-b8c0-4058-b576-6117e9ed5b8c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030533 Apr 11 14:04:34.121343 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 497/1001] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:04:37.054617 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3b59f255-a5f6-445a-a9c6-ca1f8a9dfa6c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:37.055157 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3b59f255-a5f6-445a-a9c6-ca1f8a9dfa6c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:37.061056 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3b59f255-a5f6-445a-a9c6-ca1f8a9dfa6c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:37.062119 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3b59f255-a5f6-445a-a9c6-ca1f8a9dfa6c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:37.062886 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3b59f255-a5f6-445a-a9c6-ca1f8a9dfa6c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:37.063321 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3b59f255-a5f6-445a-a9c6-ca1f8a9dfa6c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:37.088290 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3b59f255-a5f6-445a-a9c6-ca1f8a9dfa6c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:04:37.162795 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3b59f255-a5f6-445a-a9c6-ca1f8a9dfa6c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 204 len: 0 microversion: 2.1 time: 0.112211 Apr 11 14:04:37.163393 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 505/1002] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:04:37 2022] DELETE /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:04:37.174968 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bc4176e7-3a85-4499-9c97-6f5cadb4520a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:37.175904 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bc4176e7-3a85-4499-9c97-6f5cadb4520a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:37.183138 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bc4176e7-3a85-4499-9c97-6f5cadb4520a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:37.183593 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bc4176e7-3a85-4499-9c97-6f5cadb4520a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:37.184390 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bc4176e7-3a85-4499-9c97-6f5cadb4520a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:37.184831 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bc4176e7-3a85-4499-9c97-6f5cadb4520a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:37.316199 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-bc4176e7-3a85-4499-9c97-6f5cadb4520a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:37.323489 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bc4176e7-3a85-4499-9c97-6f5cadb4520a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1579 microversion: 2.1 time: 0.154782 Apr 11 14:04:37.324093 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 498/1003] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:37 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:38.341384 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cc7be797-2b35-4eee-a578-b41b3736c95a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:38.342089 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cc7be797-2b35-4eee-a578-b41b3736c95a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:38.348531 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cc7be797-2b35-4eee-a578-b41b3736c95a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:38.349037 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cc7be797-2b35-4eee-a578-b41b3736c95a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:38.349874 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cc7be797-2b35-4eee-a578-b41b3736c95a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:38.350315 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cc7be797-2b35-4eee-a578-b41b3736c95a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:38.482909 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cc7be797-2b35-4eee-a578-b41b3736c95a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:38.490839 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cc7be797-2b35-4eee-a578-b41b3736c95a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1579 microversion: 2.1 time: 0.153775 Apr 11 14:04:38.491401 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 506/1004] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:38 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:39.454217 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-d46afb8c-ef6a-4e7e-8e7f-60a1ab1523b3 req-3dfdecd7-a832-4d77-a3c6-142ed6d8a79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3758fe41-ad1e-4bbb-a152-9cc831519aca", "name": "network-vif-deleted", "tag": "64a97990-f586-4554-ba0f-e0bf82738eaf"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:39.465108 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-d46afb8c-ef6a-4e7e-8e7f-60a1ab1523b3 req-3dfdecd7-a832-4d77-a3c6-142ed6d8a79f service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:39.465574 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-d46afb8c-ef6a-4e7e-8e7f-60a1ab1523b3 req-3dfdecd7-a832-4d77-a3c6-142ed6d8a79f service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:39.480187 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-d46afb8c-ef6a-4e7e-8e7f-60a1ab1523b3 req-3dfdecd7-a832-4d77-a3c6-142ed6d8a79f service nova] Creating event network-vif-deleted:64a97990-f586-4554-ba0f-e0bf82738eaf for instance 3758fe41-ad1e-4bbb-a152-9cc831519aca on hv-cinder-83078 Apr 11 14:04:39.486003 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-d46afb8c-ef6a-4e7e-8e7f-60a1ab1523b3 req-3dfdecd7-a832-4d77-a3c6-142ed6d8a79f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035486 Apr 11 14:04:39.486647 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 499/1005] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:04:39.508867 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cf72d430-cfe1-4993-9656-4c0b8b5b1831 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:39.509749 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cf72d430-cfe1-4993-9656-4c0b8b5b1831 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:39.516598 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cf72d430-cfe1-4993-9656-4c0b8b5b1831 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:39.517052 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cf72d430-cfe1-4993-9656-4c0b8b5b1831 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:39.517833 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cf72d430-cfe1-4993-9656-4c0b8b5b1831 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:39.518479 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cf72d430-cfe1-4993-9656-4c0b8b5b1831 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:39.589086 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cf72d430-cfe1-4993-9656-4c0b8b5b1831 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:39.597501 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cf72d430-cfe1-4993-9656-4c0b8b5b1831 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 200 len: 1226 microversion: 2.1 time: 0.092993 Apr 11 14:04:39.598386 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 507/1006] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:39 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:40.615811 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-62d5bca1-cfe8-4fb5-96fb-391ff21e30fc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:40.616521 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-62d5bca1-cfe8-4fb5-96fb-391ff21e30fc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:40.622585 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62d5bca1-cfe8-4fb5-96fb-391ff21e30fc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:40.623035 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62d5bca1-cfe8-4fb5-96fb-391ff21e30fc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:40.623834 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62d5bca1-cfe8-4fb5-96fb-391ff21e30fc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:40.624273 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62d5bca1-cfe8-4fb5-96fb-391ff21e30fc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:40.636830 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-62d5bca1-cfe8-4fb5-96fb-391ff21e30fc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] HTTP exception thrown: Instance 3758fe41-ad1e-4bbb-a152-9cc831519aca could not be found. Apr 11 14:04:40.637406 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-62d5bca1-cfe8-4fb5-96fb-391ff21e30fc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Returning 404 to user: Instance 3758fe41-ad1e-4bbb-a152-9cc831519aca could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:04:40.638217 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-62d5bca1-cfe8-4fb5-96fb-391ff21e30fc tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 404 len: 111 microversion: 2.1 time: 0.027135 Apr 11 14:04:40.638738 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 500/1007] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:40 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:04:40.730271 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1991274589", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1198794692", "security_groups": [{"name": "tempest-secgroup-smoke-1672236242"}], "block_device_mapping_v2": [{"uuid": "356b2bef-e929-4677-a22b-28870bc11eba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ad25a564-6f6a-4aa0-9d80-81636d1b0cca"}]}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:40.837536 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] validate_networks() for [('ad25a564-6f6a-4aa0-9d80-81636d1b0cca', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 14:04:41.189191 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 14:04:41.189640 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 14:04:41.190116 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 14:04:41.190563 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 14:04:41.190977 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 14:04:41.199743 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:41.200193 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:41.201002 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:41.201436 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:41.217687 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Getting quotas for project 40c040f0c3e74276bcab8dbc8e439de5. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:04:41.222297 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Getting quotas for user 64643f7804ba42f5886f949134dd4d06 and project 40c040f0c3e74276bcab8dbc8e439de5. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:04:41.278763 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 14:04:41.280912 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='356b2bef-e929-4677-a22b-28870bc11eba',volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 14:04:41.403052 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a964075e-79ad-42a8-8f0b-f522e285c402 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.676534 Apr 11 14:04:41.403728 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 508/1008] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 14:04:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 14:04:41.414006 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0bfa8099-4f3e-42fa-9fe2-a73d5887c134 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:41.414636 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0bfa8099-4f3e-42fa-9fe2-a73d5887c134 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:41.467518 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0bfa8099-4f3e-42fa-9fe2-a73d5887c134 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:41.474352 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0bfa8099-4f3e-42fa-9fe2-a73d5887c134 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1095 microversion: 2.1 time: 0.064220 Apr 11 14:04:41.474930 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 501/1009] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:41 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:42.492239 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-de9f043d-057c-4157-80b7-2839041de2a4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:42.493032 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-de9f043d-057c-4157-80b7-2839041de2a4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:42.498965 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-de9f043d-057c-4157-80b7-2839041de2a4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:42.499512 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-de9f043d-057c-4157-80b7-2839041de2a4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:42.501039 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-de9f043d-057c-4157-80b7-2839041de2a4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:42.501542 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-de9f043d-057c-4157-80b7-2839041de2a4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:42.574473 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-de9f043d-057c-4157-80b7-2839041de2a4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:42.582752 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-de9f043d-057c-4157-80b7-2839041de2a4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1211 microversion: 2.1 time: 0.094862 Apr 11 14:04:42.583327 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 509/1010] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:42 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:43.600385 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a09f7f5e-22ec-4ef9-b861-aaabf7f9164d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:43.601004 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a09f7f5e-22ec-4ef9-b861-aaabf7f9164d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:43.608048 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a09f7f5e-22ec-4ef9-b861-aaabf7f9164d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:43.608507 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a09f7f5e-22ec-4ef9-b861-aaabf7f9164d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:43.609281 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a09f7f5e-22ec-4ef9-b861-aaabf7f9164d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:43.610355 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a09f7f5e-22ec-4ef9-b861-aaabf7f9164d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:43.761197 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a09f7f5e-22ec-4ef9-b861-aaabf7f9164d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:43.769898 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a09f7f5e-22ec-4ef9-b861-aaabf7f9164d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1267 microversion: 2.1 time: 0.174443 Apr 11 14:04:43.770481 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 502/1011] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:43 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:04:43.864141 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-6656f48e-b1d2-45d3-9c06-81be78430c6e req-ea1dbf72-aaea-4356-a101-70da12a47086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68774bfd-baf3-4cab-8d21-d9397b9bb4e0", "tag": "57ad0c82-296e-406b-ada6-95602f83f661"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:43.874111 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-6656f48e-b1d2-45d3-9c06-81be78430c6e req-ea1dbf72-aaea-4356-a101-70da12a47086 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:43.874845 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-6656f48e-b1d2-45d3-9c06-81be78430c6e req-ea1dbf72-aaea-4356-a101-70da12a47086 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:43.887694 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-6656f48e-b1d2-45d3-9c06-81be78430c6e req-ea1dbf72-aaea-4356-a101-70da12a47086 service nova] Creating event network-changed:57ad0c82-296e-406b-ada6-95602f83f661 for instance 68774bfd-baf3-4cab-8d21-d9397b9bb4e0 on hv-cinder-83078 Apr 11 14:04:43.893780 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-6656f48e-b1d2-45d3-9c06-81be78430c6e req-ea1dbf72-aaea-4356-a101-70da12a47086 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033502 Apr 11 14:04:43.895819 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 510/1012] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:04:44.787039 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a7e80a81-536e-4d4b-ae48-341f1038182b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:44.787572 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a7e80a81-536e-4d4b-ae48-341f1038182b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:44.793757 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a7e80a81-536e-4d4b-ae48-341f1038182b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:44.794218 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a7e80a81-536e-4d4b-ae48-341f1038182b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:44.794991 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a7e80a81-536e-4d4b-ae48-341f1038182b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:44.795431 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a7e80a81-536e-4d4b-ae48-341f1038182b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:44.925668 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a7e80a81-536e-4d4b-ae48-341f1038182b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:44.932873 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a7e80a81-536e-4d4b-ae48-341f1038182b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1267 microversion: 2.1 time: 0.149761 Apr 11 14:04:44.933440 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 503/1013] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:44 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:45.951267 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-763cc952-5499-43a4-8199-f081f2fd37ee tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:45.951915 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-763cc952-5499-43a4-8199-f081f2fd37ee tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:45.958117 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-763cc952-5499-43a4-8199-f081f2fd37ee tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:45.958567 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-763cc952-5499-43a4-8199-f081f2fd37ee tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:45.959316 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-763cc952-5499-43a4-8199-f081f2fd37ee tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:45.959783 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-763cc952-5499-43a4-8199-f081f2fd37ee tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:46.087568 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-763cc952-5499-43a4-8199-f081f2fd37ee tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:46.095408 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-763cc952-5499-43a4-8199-f081f2fd37ee tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1267 microversion: 2.1 time: 0.148224 Apr 11 14:04:46.096115 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 511/1014] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:45 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:47.112143 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-71fa9cdb-08c7-4af9-b367-7be1fe1e4f81 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:47.112789 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-71fa9cdb-08c7-4af9-b367-7be1fe1e4f81 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:47.118638 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-71fa9cdb-08c7-4af9-b367-7be1fe1e4f81 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:47.119092 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-71fa9cdb-08c7-4af9-b367-7be1fe1e4f81 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:47.119879 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-71fa9cdb-08c7-4af9-b367-7be1fe1e4f81 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:47.120314 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-71fa9cdb-08c7-4af9-b367-7be1fe1e4f81 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:47.246370 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-71fa9cdb-08c7-4af9-b367-7be1fe1e4f81 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:47.254424 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-71fa9cdb-08c7-4af9-b367-7be1fe1e4f81 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1267 microversion: 2.1 time: 0.146745 Apr 11 14:04:47.254993 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 504/1015] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:47 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:48.271189 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-11a87dc9-64a7-45a6-a079-6399864ce215 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:48.271835 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-11a87dc9-64a7-45a6-a079-6399864ce215 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:48.278255 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-11a87dc9-64a7-45a6-a079-6399864ce215 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:48.278694 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-11a87dc9-64a7-45a6-a079-6399864ce215 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:48.279450 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-11a87dc9-64a7-45a6-a079-6399864ce215 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:48.279913 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-11a87dc9-64a7-45a6-a079-6399864ce215 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:48.413600 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-11a87dc9-64a7-45a6-a079-6399864ce215 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:48.420789 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-11a87dc9-64a7-45a6-a079-6399864ce215 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1267 microversion: 2.1 time: 0.154431 Apr 11 14:04:48.421348 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 512/1016] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:48 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:49.437364 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a8e34337-734f-4a6a-90d8-9aae904bc193 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:49.437979 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a8e34337-734f-4a6a-90d8-9aae904bc193 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:49.444343 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a8e34337-734f-4a6a-90d8-9aae904bc193 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:49.444793 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a8e34337-734f-4a6a-90d8-9aae904bc193 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:49.445553 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a8e34337-734f-4a6a-90d8-9aae904bc193 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:49.445983 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a8e34337-734f-4a6a-90d8-9aae904bc193 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:49.574509 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a8e34337-734f-4a6a-90d8-9aae904bc193 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:49.581891 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a8e34337-734f-4a6a-90d8-9aae904bc193 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1267 microversion: 2.1 time: 0.148396 Apr 11 14:04:49.582463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 505/1017] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:49 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:50.598652 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6e10aa41-8a3c-40d5-96f3-347fc5bf22be tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:50.599264 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6e10aa41-8a3c-40d5-96f3-347fc5bf22be tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:50.605594 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e10aa41-8a3c-40d5-96f3-347fc5bf22be tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:50.606064 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e10aa41-8a3c-40d5-96f3-347fc5bf22be tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:50.606802 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e10aa41-8a3c-40d5-96f3-347fc5bf22be tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:50.607236 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e10aa41-8a3c-40d5-96f3-347fc5bf22be tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:50.733544 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6e10aa41-8a3c-40d5-96f3-347fc5bf22be tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:50.741387 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6e10aa41-8a3c-40d5-96f3-347fc5bf22be tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1267 microversion: 2.1 time: 0.146720 Apr 11 14:04:50.741966 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 513/1018] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:50 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:51.758409 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fc6ee75f-8085-42c4-999d-883324aab802 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:51.759145 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fc6ee75f-8085-42c4-999d-883324aab802 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:51.766022 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fc6ee75f-8085-42c4-999d-883324aab802 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:51.766480 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fc6ee75f-8085-42c4-999d-883324aab802 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:51.767289 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fc6ee75f-8085-42c4-999d-883324aab802 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:51.768083 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fc6ee75f-8085-42c4-999d-883324aab802 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:51.897183 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fc6ee75f-8085-42c4-999d-883324aab802 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:51.904986 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fc6ee75f-8085-42c4-999d-883324aab802 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1267 microversion: 2.1 time: 0.150870 Apr 11 14:04:51.905552 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 506/1019] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:51 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:52.922874 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-488259a5-da23-4eab-993c-bb763231a299 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:52.923500 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-488259a5-da23-4eab-993c-bb763231a299 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:52.930142 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-488259a5-da23-4eab-993c-bb763231a299 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:52.930600 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-488259a5-da23-4eab-993c-bb763231a299 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:52.931379 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-488259a5-da23-4eab-993c-bb763231a299 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:52.931849 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-488259a5-da23-4eab-993c-bb763231a299 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:53.069000 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-488259a5-da23-4eab-993c-bb763231a299 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:53.076475 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-488259a5-da23-4eab-993c-bb763231a299 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1267 microversion: 2.1 time: 0.158350 Apr 11 14:04:53.077374 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 514/1020] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:52 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:53.089644 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-af5af509-06b2-411d-ba48-b5a56b55df44 req-ae90cea9-6bcc-46bd-847f-39a39ae47be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68774bfd-baf3-4cab-8d21-d9397b9bb4e0", "name": "network-vif-plugged", "status": "completed", "tag": "57ad0c82-296e-406b-ada6-95602f83f661"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:53.098568 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-af5af509-06b2-411d-ba48-b5a56b55df44 req-ae90cea9-6bcc-46bd-847f-39a39ae47be0 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:53.099072 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-af5af509-06b2-411d-ba48-b5a56b55df44 req-ae90cea9-6bcc-46bd-847f-39a39ae47be0 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:53.110781 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-af5af509-06b2-411d-ba48-b5a56b55df44 req-ae90cea9-6bcc-46bd-847f-39a39ae47be0 service nova] Creating event network-vif-plugged:57ad0c82-296e-406b-ada6-95602f83f661 for instance 68774bfd-baf3-4cab-8d21-d9397b9bb4e0 on hv-cinder-83078 Apr 11 14:04:53.116290 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-af5af509-06b2-411d-ba48-b5a56b55df44 req-ae90cea9-6bcc-46bd-847f-39a39ae47be0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030092 Apr 11 14:04:53.116874 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 507/1021] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:04:54.093386 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-61b9c75f-28a1-4dab-ab59-b72bca1673f3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:54.093937 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-61b9c75f-28a1-4dab-ab59-b72bca1673f3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:54.100821 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-61b9c75f-28a1-4dab-ab59-b72bca1673f3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:54.101271 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-61b9c75f-28a1-4dab-ab59-b72bca1673f3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:54.102066 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-61b9c75f-28a1-4dab-ab59-b72bca1673f3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:54.102503 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-61b9c75f-28a1-4dab-ab59-b72bca1673f3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:54.231496 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-61b9c75f-28a1-4dab-ab59-b72bca1673f3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:54.238937 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-61b9c75f-28a1-4dab-ab59-b72bca1673f3 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1267 microversion: 2.1 time: 0.149599 Apr 11 14:04:54.239527 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 515/1022] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:54 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:55.256655 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-54a69ec2-c341-49f2-afc8-2f7b0d112b08 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:55.257358 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-54a69ec2-c341-49f2-afc8-2f7b0d112b08 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:55.263647 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-54a69ec2-c341-49f2-afc8-2f7b0d112b08 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:55.264117 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-54a69ec2-c341-49f2-afc8-2f7b0d112b08 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:55.264893 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-54a69ec2-c341-49f2-afc8-2f7b0d112b08 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:55.265608 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-54a69ec2-c341-49f2-afc8-2f7b0d112b08 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:55.394960 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-54a69ec2-c341-49f2-afc8-2f7b0d112b08 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:55.402884 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-54a69ec2-c341-49f2-afc8-2f7b0d112b08 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1453 microversion: 2.1 time: 0.151127 Apr 11 14:04:55.403455 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 508/1023] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:55 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:55.418603 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8539576e-4d0b-4b66-8efc-348b8e05de1b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:04:55.419219 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8539576e-4d0b-4b66-8efc-348b8e05de1b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:04:55.425520 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8539576e-4d0b-4b66-8efc-348b8e05de1b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:55.426132 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8539576e-4d0b-4b66-8efc-348b8e05de1b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:55.426900 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8539576e-4d0b-4b66-8efc-348b8e05de1b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:55.427334 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8539576e-4d0b-4b66-8efc-348b8e05de1b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:55.557713 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8539576e-4d0b-4b66-8efc-348b8e05de1b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:04:55.564937 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8539576e-4d0b-4b66-8efc-348b8e05de1b tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1453 microversion: 2.1 time: 0.150209 Apr 11 14:04:55.565510 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 516/1024] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:04:55 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:04:57.162620 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-4dcabb58-113a-4934-8209-a20e45e49250 req-6f585c64-a8fb-4aa4-a291-e720ad3798a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68774bfd-baf3-4cab-8d21-d9397b9bb4e0", "tag": "57ad0c82-296e-406b-ada6-95602f83f661"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:04:57.170880 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-4dcabb58-113a-4934-8209-a20e45e49250 req-6f585c64-a8fb-4aa4-a291-e720ad3798a4 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:04:57.171332 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-4dcabb58-113a-4934-8209-a20e45e49250 req-6f585c64-a8fb-4aa4-a291-e720ad3798a4 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:04:57.183356 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-4dcabb58-113a-4934-8209-a20e45e49250 req-6f585c64-a8fb-4aa4-a291-e720ad3798a4 service nova] Creating event network-changed:57ad0c82-296e-406b-ada6-95602f83f661 for instance 68774bfd-baf3-4cab-8d21-d9397b9bb4e0 on hv-cinder-83078 Apr 11 14:04:57.188525 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-4dcabb58-113a-4934-8209-a20e45e49250 req-6f585c64-a8fb-4aa4-a291-e720ad3798a4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030138 Apr 11 14:04:57.189166 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 509/1025] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:05:06.581584 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2179b352-99c0-4da4-a08a-9e8a15bb48ad tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:06.582157 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2179b352-99c0-4da4-a08a-9e8a15bb48ad tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:06.588523 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2179b352-99c0-4da4-a08a-9e8a15bb48ad tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:06.588992 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2179b352-99c0-4da4-a08a-9e8a15bb48ad tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:06.589744 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2179b352-99c0-4da4-a08a-9e8a15bb48ad tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:06.590182 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2179b352-99c0-4da4-a08a-9e8a15bb48ad tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:06.612410 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2179b352-99c0-4da4-a08a-9e8a15bb48ad tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e/ips" status: 200 len: 150 microversion: 2.1 time: 0.034693 Apr 11 14:05:06.613003 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 517/1026] 10.222.0.67 () {58 vars in 1247 bytes} [Mon Apr 11 14:05:06 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:05:07.917305 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-884d0976-7f08-4e91-b989-c14786f248ac tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3601fe2e-1e61-4cbc-834c-2ecf061283e6"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:05:07.918596 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-884d0976-7f08-4e91-b989-c14786f248ac tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:07.924672 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-884d0976-7f08-4e91-b989-c14786f248ac tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:07.925134 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-884d0976-7f08-4e91-b989-c14786f248ac tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:07.925909 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-884d0976-7f08-4e91-b989-c14786f248ac tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:07.926357 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-884d0976-7f08-4e91-b989-c14786f248ac tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:08.161094 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-884d0976-7f08-4e91-b989-c14786f248ac tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "POST /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248193 Apr 11 14:05:08.161722 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 510/1027] 10.222.0.67 () {60 vars in 1322 bytes} [Mon Apr 11 14:05:07 2022] POST /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:05:14.674007 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f0353093-f64a-4774-8c95-57393d15c640 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:14.674500 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f0353093-f64a-4774-8c95-57393d15c640 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:14.680943 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f0353093-f64a-4774-8c95-57393d15c640 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:14.681420 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f0353093-f64a-4774-8c95-57393d15c640 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:14.682181 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f0353093-f64a-4774-8c95-57393d15c640 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:14.682621 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f0353093-f64a-4774-8c95-57393d15c640 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:14.758188 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-f0353093-f64a-4774-8c95-57393d15c640 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lazy-loading 'services' on Instance uuid 03da3e44-70ae-4f78-96da-9dcf86b4576e {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:05:14.826083 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f0353093-f64a-4774-8c95-57393d15c640 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e/os-volume_attachments/3601fe2e-1e61-4cbc-834c-2ecf061283e6" status: 202 len: 0 microversion: 2.1 time: 0.155778 Apr 11 14:05:14.826677 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 518/1028] 10.222.0.67 () {58 vars in 1415 bytes} [Mon Apr 11 14:05:14 2022] DELETE /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e/os-volume_attachments/3601fe2e-1e61-4cbc-834c-2ecf061283e6 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:05:14.836196 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0305cacb-cb0c-49c4-9dc2-b3b8276ee641 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:14.837843 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0305cacb-cb0c-49c4-9dc2-b3b8276ee641 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:14.844817 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0305cacb-cb0c-49c4-9dc2-b3b8276ee641 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:14.845367 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0305cacb-cb0c-49c4-9dc2-b3b8276ee641 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:14.846262 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0305cacb-cb0c-49c4-9dc2-b3b8276ee641 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:14.846726 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0305cacb-cb0c-49c4-9dc2-b3b8276ee641 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:14.878032 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0305cacb-cb0c-49c4-9dc2-b3b8276ee641 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046215 Apr 11 14:05:14.878577 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 511/1029] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:05:14 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:05:15.890612 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bc6dc4a8-9767-43b8-bba0-251c8caa9eef tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:15.891620 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bc6dc4a8-9767-43b8-bba0-251c8caa9eef tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:15.897688 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bc6dc4a8-9767-43b8-bba0-251c8caa9eef tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:15.898387 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bc6dc4a8-9767-43b8-bba0-251c8caa9eef tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:15.899147 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bc6dc4a8-9767-43b8-bba0-251c8caa9eef tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:15.899732 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bc6dc4a8-9767-43b8-bba0-251c8caa9eef tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:15.926909 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bc6dc4a8-9767-43b8-bba0-251c8caa9eef tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040979 Apr 11 14:05:15.927393 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 519/1030] 10.222.0.67 () {58 vars in 1301 bytes} [Mon Apr 11 14:05:15 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 14:05:15.983011 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e2e419d9-7f80-498f-b082-81e8976f0489 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:15.983498 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e2e419d9-7f80-498f-b082-81e8976f0489 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:15.989745 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e2e419d9-7f80-498f-b082-81e8976f0489 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:15.990209 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e2e419d9-7f80-498f-b082-81e8976f0489 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:15.990983 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e2e419d9-7f80-498f-b082-81e8976f0489 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:15.991427 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e2e419d9-7f80-498f-b082-81e8976f0489 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:16.014715 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e2e419d9-7f80-498f-b082-81e8976f0489 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:05:16.089391 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e2e419d9-7f80-498f-b082-81e8976f0489 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 204 len: 0 microversion: 2.1 time: 0.109769 Apr 11 14:05:16.090095 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 512/1031] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:05:15 2022] DELETE /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:05:16.099151 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3cd538bc-f832-4504-a7c7-b69432ca400e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:16.099816 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3cd538bc-f832-4504-a7c7-b69432ca400e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:16.106628 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3cd538bc-f832-4504-a7c7-b69432ca400e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:16.107075 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3cd538bc-f832-4504-a7c7-b69432ca400e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:16.107896 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3cd538bc-f832-4504-a7c7-b69432ca400e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:16.108326 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3cd538bc-f832-4504-a7c7-b69432ca400e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:16.238566 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-3cd538bc-f832-4504-a7c7-b69432ca400e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:05:16.245956 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3cd538bc-f832-4504-a7c7-b69432ca400e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 200 len: 1683 microversion: 2.1 time: 0.150755 Apr 11 14:05:16.246529 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 520/1032] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:05:16 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:05:17.264399 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-afda27b7-8e61-4c51-ab3b-07ac3d2ef8fd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:17.265113 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-afda27b7-8e61-4c51-ab3b-07ac3d2ef8fd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:17.271353 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-afda27b7-8e61-4c51-ab3b-07ac3d2ef8fd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:17.271845 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-afda27b7-8e61-4c51-ab3b-07ac3d2ef8fd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:17.272621 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-afda27b7-8e61-4c51-ab3b-07ac3d2ef8fd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:17.273319 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-afda27b7-8e61-4c51-ab3b-07ac3d2ef8fd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:17.401934 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-afda27b7-8e61-4c51-ab3b-07ac3d2ef8fd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:05:17.409171 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-afda27b7-8e61-4c51-ab3b-07ac3d2ef8fd tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 200 len: 1683 microversion: 2.1 time: 0.149231 Apr 11 14:05:17.409738 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 513/1033] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:05:17 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:05:18.426529 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2094953d-cfa4-47a2-a8ce-2dd0793a40c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:18.427153 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2094953d-cfa4-47a2-a8ce-2dd0793a40c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:18.433532 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2094953d-cfa4-47a2-a8ce-2dd0793a40c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:18.433986 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2094953d-cfa4-47a2-a8ce-2dd0793a40c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:18.434773 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2094953d-cfa4-47a2-a8ce-2dd0793a40c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:18.435228 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2094953d-cfa4-47a2-a8ce-2dd0793a40c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:18.534105 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2094953d-cfa4-47a2-a8ce-2dd0793a40c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cbcdc40fea745f48e1dfc62a732b7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cddbab1b664b5a89b56d5632d2f62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:05:18.534489 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-b3286653-9cfe-42b9-ab9c-c6b588b5a5f7 req-b166d8dc-9114-4396-b5b8-9f5da14cec1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03da3e44-70ae-4f78-96da-9dcf86b4576e", "name": "network-vif-deleted", "tag": "991713fa-d7a2-4182-b74a-c6133eec42c5"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:05:18.542333 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2094953d-cfa4-47a2-a8ce-2dd0793a40c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 200 len: 1615 microversion: 2.1 time: 0.119820 Apr 11 14:05:18.551050 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-b3286653-9cfe-42b9-ab9c-c6b588b5a5f7 req-b166d8dc-9114-4396-b5b8-9f5da14cec1a service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:18.551806 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-b3286653-9cfe-42b9-ab9c-c6b588b5a5f7 req-b166d8dc-9114-4396-b5b8-9f5da14cec1a service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:18.553169 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 521/1034] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:05:18 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 1615 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:05:18.567451 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-b3286653-9cfe-42b9-ab9c-c6b588b5a5f7 req-b166d8dc-9114-4396-b5b8-9f5da14cec1a service nova] Creating event network-vif-deleted:991713fa-d7a2-4182-b74a-c6133eec42c5 for instance 03da3e44-70ae-4f78-96da-9dcf86b4576e on hv-cinder-83078 Apr 11 14:05:18.577541 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-b3286653-9cfe-42b9-ab9c-c6b588b5a5f7 req-b166d8dc-9114-4396-b5b8-9f5da14cec1a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046839 Apr 11 14:05:18.579223 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 514/1035] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:05:19.559778 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ad2c7c20-0eb1-4419-8d5e-44e6afba2f78 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:19.560428 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ad2c7c20-0eb1-4419-8d5e-44e6afba2f78 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:19.566862 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad2c7c20-0eb1-4419-8d5e-44e6afba2f78 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:19.567310 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad2c7c20-0eb1-4419-8d5e-44e6afba2f78 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:19.568107 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad2c7c20-0eb1-4419-8d5e-44e6afba2f78 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:19.568549 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ad2c7c20-0eb1-4419-8d5e-44e6afba2f78 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:19.581282 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-ad2c7c20-0eb1-4419-8d5e-44e6afba2f78 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Instance 03da3e44-70ae-4f78-96da-9dcf86b4576e could not be found. Apr 11 14:05:19.581867 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ad2c7c20-0eb1-4419-8d5e-44e6afba2f78 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 404 to user: Instance 03da3e44-70ae-4f78-96da-9dcf86b4576e could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:05:19.582676 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ad2c7c20-0eb1-4419-8d5e-44e6afba2f78 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 404 len: 111 microversion: 2.1 time: 0.027448 Apr 11 14:05:19.583200 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 522/1036] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:05:19 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:05:19.592589 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-06c89f0c-d7f6-4aa4-aef9-cfec30ca3730 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '.version_select at 0x7f7306823310>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:19.610877 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-06c89f0c-d7f6-4aa4-aef9-cfec30ca3730 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434969487" status: 202 len: 0 microversion: 2.1 time: 0.023004 Apr 11 14:05:19.611438 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 515/1037] 10.222.0.67 () {58 vars in 1220 bytes} [Mon Apr 11 14:05:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434969487 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:05:21.583194 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a78646f1-8064-423e-8638-6ca0c235b1c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:21.583722 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a78646f1-8064-423e-8638-6ca0c235b1c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:21.590579 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a78646f1-8064-423e-8638-6ca0c235b1c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:21.591027 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a78646f1-8064-423e-8638-6ca0c235b1c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:21.591824 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a78646f1-8064-423e-8638-6ca0c235b1c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:21.592265 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a78646f1-8064-423e-8638-6ca0c235b1c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:21.606343 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-a78646f1-8064-423e-8638-6ca0c235b1c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Instance 03da3e44-70ae-4f78-96da-9dcf86b4576e could not be found. Apr 11 14:05:21.606917 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a78646f1-8064-423e-8638-6ca0c235b1c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 404 to user: Instance 03da3e44-70ae-4f78-96da-9dcf86b4576e could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:05:21.607749 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a78646f1-8064-423e-8638-6ca0c235b1c3 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 404 len: 111 microversion: 2.1 time: 0.028397 Apr 11 14:05:21.608275 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 523/1038] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:05:21 2022] DELETE /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:05:21.616543 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-397e271e-5858-4cc3-a901-484ae48a9c41 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:21.617288 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-397e271e-5858-4cc3-a901-484ae48a9c41 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 03da3e44-70ae-4f78-96da-9dcf86b4576e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:21.626093 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-397e271e-5858-4cc3-a901-484ae48a9c41 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:21.626550 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-397e271e-5858-4cc3-a901-484ae48a9c41 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:21.627326 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-397e271e-5858-4cc3-a901-484ae48a9c41 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:21.627800 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-397e271e-5858-4cc3-a901-484ae48a9c41 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:21.640935 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-397e271e-5858-4cc3-a901-484ae48a9c41 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Instance 03da3e44-70ae-4f78-96da-9dcf86b4576e could not be found. Apr 11 14:05:21.641547 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-397e271e-5858-4cc3-a901-484ae48a9c41 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 404 to user: Instance 03da3e44-70ae-4f78-96da-9dcf86b4576e could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:05:21.642368 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-397e271e-5858-4cc3-a901-484ae48a9c41 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e" status: 404 len: 111 microversion: 2.1 time: 0.030199 Apr 11 14:05:21.642902 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 516/1039] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:05:21 2022] GET /compute/v2.1/servers/03da3e44-70ae-4f78-96da-9dcf86b4576e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:05:22.774426 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-476e2559-9414-4ccf-bbe8-33c51390ac68 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:22.774916 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-476e2559-9414-4ccf-bbe8-33c51390ac68 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:22.781862 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-476e2559-9414-4ccf-bbe8-33c51390ac68 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:22.782306 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-476e2559-9414-4ccf-bbe8-33c51390ac68 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:22.783070 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-476e2559-9414-4ccf-bbe8-33c51390ac68 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:22.783503 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-476e2559-9414-4ccf-bbe8-33c51390ac68 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:22.796897 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-476e2559-9414-4ccf-bbe8-33c51390ac68 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Instance e427eb53-7ff8-42d2-a90e-b07c69fc0a86 could not be found. Apr 11 14:05:22.797468 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-476e2559-9414-4ccf-bbe8-33c51390ac68 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 404 to user: Instance e427eb53-7ff8-42d2-a90e-b07c69fc0a86 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:05:22.798268 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-476e2559-9414-4ccf-bbe8-33c51390ac68 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 404 len: 111 microversion: 2.1 time: 0.027964 Apr 11 14:05:22.798783 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 524/1040] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:05:22 2022] DELETE /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:05:22.806630 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e2687e0f-f246-4864-93ac-8261519f48a8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:22.807366 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e2687e0f-f246-4864-93ac-8261519f48a8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: e427eb53-7ff8-42d2-a90e-b07c69fc0a86] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:22.813696 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e2687e0f-f246-4864-93ac-8261519f48a8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:22.814154 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e2687e0f-f246-4864-93ac-8261519f48a8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:22.814929 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e2687e0f-f246-4864-93ac-8261519f48a8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:22.815372 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e2687e0f-f246-4864-93ac-8261519f48a8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:22.828606 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-e2687e0f-f246-4864-93ac-8261519f48a8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Instance e427eb53-7ff8-42d2-a90e-b07c69fc0a86 could not be found. Apr 11 14:05:22.829188 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e2687e0f-f246-4864-93ac-8261519f48a8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 404 to user: Instance e427eb53-7ff8-42d2-a90e-b07c69fc0a86 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:05:22.830009 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e2687e0f-f246-4864-93ac-8261519f48a8 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86" status: 404 len: 111 microversion: 2.1 time: 0.027301 Apr 11 14:05:22.830531 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 517/1041] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:05:22 2022] GET /compute/v2.1/servers/e427eb53-7ff8-42d2-a90e-b07c69fc0a86 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 14:05:22.838834 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b2f2ce5c-bfb7-4480-9c7a-c58b6c110c0e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:22.839331 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b2f2ce5c-bfb7-4480-9c7a-c58b6c110c0e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:22.845139 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2f2ce5c-bfb7-4480-9c7a-c58b6c110c0e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:22.845579 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2f2ce5c-bfb7-4480-9c7a-c58b6c110c0e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:22.846330 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2f2ce5c-bfb7-4480-9c7a-c58b6c110c0e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:22.846759 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2f2ce5c-bfb7-4480-9c7a-c58b6c110c0e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:22.860029 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-b2f2ce5c-bfb7-4480-9c7a-c58b6c110c0e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Instance 14b16e2e-daa2-4b92-a76a-1616af70478a could not be found. Apr 11 14:05:22.860599 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b2f2ce5c-bfb7-4480-9c7a-c58b6c110c0e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 404 to user: Instance 14b16e2e-daa2-4b92-a76a-1616af70478a could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:05:22.861394 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b2f2ce5c-bfb7-4480-9c7a-c58b6c110c0e tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 404 len: 111 microversion: 2.1 time: 0.026878 Apr 11 14:05:22.861915 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 525/1042] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:05:22 2022] DELETE /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:05:22.869628 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8a3734c2-4ab1-4f23-b142-31f817dbc1e0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:22.870360 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8a3734c2-4ab1-4f23-b142-31f817dbc1e0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: 14b16e2e-daa2-4b92-a76a-1616af70478a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:22.876191 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8a3734c2-4ab1-4f23-b142-31f817dbc1e0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:22.876648 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8a3734c2-4ab1-4f23-b142-31f817dbc1e0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:22.877437 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8a3734c2-4ab1-4f23-b142-31f817dbc1e0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:22.877877 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8a3734c2-4ab1-4f23-b142-31f817dbc1e0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:22.890569 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-8a3734c2-4ab1-4f23-b142-31f817dbc1e0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Instance 14b16e2e-daa2-4b92-a76a-1616af70478a could not be found. Apr 11 14:05:22.891148 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8a3734c2-4ab1-4f23-b142-31f817dbc1e0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 404 to user: Instance 14b16e2e-daa2-4b92-a76a-1616af70478a could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:05:22.891991 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8a3734c2-4ab1-4f23-b142-31f817dbc1e0 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a" status: 404 len: 111 microversion: 2.1 time: 0.026304 Apr 11 14:05:22.892507 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 518/1043] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:05:22 2022] GET /compute/v2.1/servers/14b16e2e-daa2-4b92-a76a-1616af70478a => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:05:24.019902 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8152dab8-4ba0-4cdc-8d5f-12e533295e63 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:24.020461 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8152dab8-4ba0-4cdc-8d5f-12e533295e63 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:24.027466 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8152dab8-4ba0-4cdc-8d5f-12e533295e63 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:24.028029 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8152dab8-4ba0-4cdc-8d5f-12e533295e63 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:24.028814 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8152dab8-4ba0-4cdc-8d5f-12e533295e63 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:24.029264 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8152dab8-4ba0-4cdc-8d5f-12e533295e63 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:24.042778 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-8152dab8-4ba0-4cdc-8d5f-12e533295e63 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Instance b1c531fb-df98-4780-bea5-7b483075b4f9 could not be found. Apr 11 14:05:24.043363 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8152dab8-4ba0-4cdc-8d5f-12e533295e63 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 404 to user: Instance b1c531fb-df98-4780-bea5-7b483075b4f9 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:05:24.044331 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8152dab8-4ba0-4cdc-8d5f-12e533295e63 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 404 len: 111 microversion: 2.1 time: 0.028366 Apr 11 14:05:24.044850 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 526/1044] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:05:24 2022] DELETE /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:05:24.052649 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9a594c96-f728-4f22-8366-103e347f49b4 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:05:24.053273 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9a594c96-f728-4f22-8366-103e347f49b4 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] [instance: b1c531fb-df98-4780-bea5-7b483075b4f9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:05:24.060216 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9a594c96-f728-4f22-8366-103e347f49b4 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:24.060673 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9a594c96-f728-4f22-8366-103e347f49b4 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:24.061445 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9a594c96-f728-4f22-8366-103e347f49b4 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:05:24.061882 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9a594c96-f728-4f22-8366-103e347f49b4 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:05:24.074767 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-9a594c96-f728-4f22-8366-103e347f49b4 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] HTTP exception thrown: Instance b1c531fb-df98-4780-bea5-7b483075b4f9 could not be found. Apr 11 14:05:24.075357 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9a594c96-f728-4f22-8366-103e347f49b4 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] Returning 404 to user: Instance b1c531fb-df98-4780-bea5-7b483075b4f9 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:05:24.076215 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9a594c96-f728-4f22-8366-103e347f49b4 tempest-AttachVolumeNegativeTest-1979386541 tempest-AttachVolumeNegativeTest-1979386541-project] 10.222.0.67 "GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9" status: 404 len: 111 microversion: 2.1 time: 0.027447 Apr 11 14:05:24.076748 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 519/1045] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:05:24 2022] GET /compute/v2.1/servers/b1c531fb-df98-4780-bea5-7b483075b4f9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:06:31.445621 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1009636434", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1198794692", "security_groups": [{"name": "tempest-secgroup-smoke-1672236242"}], "block_device_mapping_v2": [{"uuid": "e6ff30a3-6fa1-4f8c-b46e-88d3e6f704ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ad25a564-6f6a-4aa0-9d80-81636d1b0cca"}]}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:06:31.661647 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] validate_networks() for [('ad25a564-6f6a-4aa0-9d80-81636d1b0cca', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 14:06:32.367968 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 14:06:32.369011 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 14:06:32.369485 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 14:06:32.369890 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 14:06:32.370294 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 14:06:32.379861 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:32.380316 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:32.381123 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:32.381561 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:32.398363 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Getting quotas for project 40c040f0c3e74276bcab8dbc8e439de5. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 14:06:32.402543 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Getting quotas for user 64643f7804ba42f5886f949134dd4d06 and project 40c040f0c3e74276bcab8dbc8e439de5. Resources: {'ram', 'instances', 'cores'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 14:06:32.457999 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 14:06:32.460113 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6ff30a3-6fa1-4f8c-b46e-88d3e6f704ec',volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 14:06:32.588802 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a14bdf9c-c111-482a-b6ae-ded6a2e2d536 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.147888 Apr 11 14:06:32.589605 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 527/1046] 10.222.0.67 () {60 vars in 1146 bytes} [Mon Apr 11 14:06:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 14:06:32.600352 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8f422d7c-dce7-4832-b99a-dbcbf52c4e19 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:06:32.600971 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8f422d7c-dce7-4832-b99a-dbcbf52c4e19 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:06:32.710140 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8f422d7c-dce7-4832-b99a-dbcbf52c4e19 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:06:32.717254 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8f422d7c-dce7-4832-b99a-dbcbf52c4e19 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 200 len: 1095 microversion: 2.1 time: 0.121766 Apr 11 14:06:32.717823 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 520/1047] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:06:32 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 1095 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 14:06:33.735259 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fe698745-fa1c-4f22-9802-858686155c1a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:06:33.735989 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fe698745-fa1c-4f22-9802-858686155c1a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:06:33.743111 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fe698745-fa1c-4f22-9802-858686155c1a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:33.743702 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fe698745-fa1c-4f22-9802-858686155c1a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:33.744577 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fe698745-fa1c-4f22-9802-858686155c1a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:33.745080 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fe698745-fa1c-4f22-9802-858686155c1a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:33.825958 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fe698745-fa1c-4f22-9802-858686155c1a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:06:33.833183 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fe698745-fa1c-4f22-9802-858686155c1a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 200 len: 1211 microversion: 2.1 time: 0.102929 Apr 11 14:06:33.833749 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 528/1048] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:06:33 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:06:34.850733 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ff3352a1-4c13-4a83-9a24-fbf541277764 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:06:34.851998 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ff3352a1-4c13-4a83-9a24-fbf541277764 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:06:34.860768 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff3352a1-4c13-4a83-9a24-fbf541277764 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:34.861471 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff3352a1-4c13-4a83-9a24-fbf541277764 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:34.862274 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff3352a1-4c13-4a83-9a24-fbf541277764 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:34.862715 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff3352a1-4c13-4a83-9a24-fbf541277764 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:35.004783 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ff3352a1-4c13-4a83-9a24-fbf541277764 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:06:35.016307 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ff3352a1-4c13-4a83-9a24-fbf541277764 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 200 len: 1267 microversion: 2.1 time: 0.169519 Apr 11 14:06:35.017409 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 521/1049] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:06:34 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:06:35.101968 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-c50625e4-680c-495e-9964-b8fd22a85ff3 req-4b4c1654-18b9-4e3d-bfc8-a213106bd90f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6026426-fd47-46b0-a22f-45ebf0500fb9", "tag": "98f3aec3-741b-4557-a19c-a2befc8b4060"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:06:35.111920 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-c50625e4-680c-495e-9964-b8fd22a85ff3 req-4b4c1654-18b9-4e3d-bfc8-a213106bd90f service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:35.112439 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-c50625e4-680c-495e-9964-b8fd22a85ff3 req-4b4c1654-18b9-4e3d-bfc8-a213106bd90f service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:35.124233 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-c50625e4-680c-495e-9964-b8fd22a85ff3 req-4b4c1654-18b9-4e3d-bfc8-a213106bd90f service nova] Creating event network-changed:98f3aec3-741b-4557-a19c-a2befc8b4060 for instance a6026426-fd47-46b0-a22f-45ebf0500fb9 on hv-cinder-83078 Apr 11 14:06:35.129663 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-c50625e4-680c-495e-9964-b8fd22a85ff3 req-4b4c1654-18b9-4e3d-bfc8-a213106bd90f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101498 Apr 11 14:06:35.130584 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 529/1050] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:06:36.034097 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-96d7fe20-498d-41fe-becc-8843c7807ba2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:06:36.034722 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-96d7fe20-498d-41fe-becc-8843c7807ba2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:06:36.041463 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-96d7fe20-498d-41fe-becc-8843c7807ba2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:36.041920 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-96d7fe20-498d-41fe-becc-8843c7807ba2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:36.042717 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-96d7fe20-498d-41fe-becc-8843c7807ba2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:36.043160 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-96d7fe20-498d-41fe-becc-8843c7807ba2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:36.172514 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-96d7fe20-498d-41fe-becc-8843c7807ba2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:06:36.179981 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-96d7fe20-498d-41fe-becc-8843c7807ba2 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 200 len: 1267 microversion: 2.1 time: 0.150122 Apr 11 14:06:36.180550 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 522/1051] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:06:36 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:06:37.198682 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-795d0a2c-d412-4cff-aa98-5c8326a1ab48 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:06:37.199384 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-795d0a2c-d412-4cff-aa98-5c8326a1ab48 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:06:37.205515 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-795d0a2c-d412-4cff-aa98-5c8326a1ab48 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:37.205966 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-795d0a2c-d412-4cff-aa98-5c8326a1ab48 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:37.206733 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-795d0a2c-d412-4cff-aa98-5c8326a1ab48 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:37.207168 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-795d0a2c-d412-4cff-aa98-5c8326a1ab48 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:37.338676 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-795d0a2c-d412-4cff-aa98-5c8326a1ab48 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:06:37.345977 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-795d0a2c-d412-4cff-aa98-5c8326a1ab48 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 200 len: 1267 microversion: 2.1 time: 0.152677 Apr 11 14:06:37.346540 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 530/1052] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:06:37 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:06:38.362286 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-89c780b5-f5e1-432e-9cf4-a4f940c8ec79 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:06:38.362936 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-89c780b5-f5e1-432e-9cf4-a4f940c8ec79 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:06:38.369233 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89c780b5-f5e1-432e-9cf4-a4f940c8ec79 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:38.370342 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89c780b5-f5e1-432e-9cf4-a4f940c8ec79 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:38.371088 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89c780b5-f5e1-432e-9cf4-a4f940c8ec79 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:38.371528 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89c780b5-f5e1-432e-9cf4-a4f940c8ec79 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:38.501331 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-89c780b5-f5e1-432e-9cf4-a4f940c8ec79 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:06:38.508601 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-89c780b5-f5e1-432e-9cf4-a4f940c8ec79 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 200 len: 1267 microversion: 2.1 time: 0.150187 Apr 11 14:06:38.509193 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 523/1053] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:06:38 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:06:39.525662 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0e7497d0-dd30-437d-9546-52d3970ca685 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:06:39.526394 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0e7497d0-dd30-437d-9546-52d3970ca685 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:06:39.533409 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e7497d0-dd30-437d-9546-52d3970ca685 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:39.533868 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e7497d0-dd30-437d-9546-52d3970ca685 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:39.534642 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e7497d0-dd30-437d-9546-52d3970ca685 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:39.535083 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e7497d0-dd30-437d-9546-52d3970ca685 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:39.672650 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0e7497d0-dd30-437d-9546-52d3970ca685 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:06:39.680241 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-0f83767f-fb93-41c0-9b2d-7a9b1a6495b2 req-f7f60438-dddc-4d8c-b589-026c89395f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6026426-fd47-46b0-a22f-45ebf0500fb9", "name": "network-vif-plugged", "status": "completed", "tag": "98f3aec3-741b-4557-a19c-a2befc8b4060"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:06:39.680788 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0e7497d0-dd30-437d-9546-52d3970ca685 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 200 len: 1267 microversion: 2.1 time: 0.158942 Apr 11 14:06:39.681307 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 531/1054] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:06:39 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:06:39.690175 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-0f83767f-fb93-41c0-9b2d-7a9b1a6495b2 req-f7f60438-dddc-4d8c-b589-026c89395f01 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:39.690175 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-0f83767f-fb93-41c0-9b2d-7a9b1a6495b2 req-f7f60438-dddc-4d8c-b589-026c89395f01 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:39.701379 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-0f83767f-fb93-41c0-9b2d-7a9b1a6495b2 req-f7f60438-dddc-4d8c-b589-026c89395f01 service nova] Creating event network-vif-plugged:98f3aec3-741b-4557-a19c-a2befc8b4060 for instance a6026426-fd47-46b0-a22f-45ebf0500fb9 on hv-cinder-83078 Apr 11 14:06:39.706398 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-0f83767f-fb93-41c0-9b2d-7a9b1a6495b2 req-f7f60438-dddc-4d8c-b589-026c89395f01 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093975 Apr 11 14:06:39.707011 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 524/1055] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:06:40.697977 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bdcee72d-c807-4f8b-882c-6ded61ef38e0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:06:40.698512 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bdcee72d-c807-4f8b-882c-6ded61ef38e0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:06:40.705352 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bdcee72d-c807-4f8b-882c-6ded61ef38e0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:40.705793 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bdcee72d-c807-4f8b-882c-6ded61ef38e0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:40.706545 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bdcee72d-c807-4f8b-882c-6ded61ef38e0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:40.706973 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bdcee72d-c807-4f8b-882c-6ded61ef38e0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:40.837015 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-bdcee72d-c807-4f8b-882c-6ded61ef38e0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:06:40.844245 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bdcee72d-c807-4f8b-882c-6ded61ef38e0 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 200 len: 1267 microversion: 2.1 time: 0.150235 Apr 11 14:06:40.844812 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 532/1056] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:06:40 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:06:41.861615 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-47a58db0-6ba2-4b47-805f-3c49c86f2000 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:06:41.862313 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-47a58db0-6ba2-4b47-805f-3c49c86f2000 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:06:41.868392 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47a58db0-6ba2-4b47-805f-3c49c86f2000 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:41.868837 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47a58db0-6ba2-4b47-805f-3c49c86f2000 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:41.869596 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47a58db0-6ba2-4b47-805f-3c49c86f2000 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:41.870030 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47a58db0-6ba2-4b47-805f-3c49c86f2000 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:42.002645 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-47a58db0-6ba2-4b47-805f-3c49c86f2000 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:06:42.009949 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-47a58db0-6ba2-4b47-805f-3c49c86f2000 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 200 len: 1453 microversion: 2.1 time: 0.152890 Apr 11 14:06:42.010497 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 525/1057] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:06:41 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:06:42.025974 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fefe1937-3ed9-4b60-87d2-8bb7d59642ac tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:06:42.026591 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fefe1937-3ed9-4b60-87d2-8bb7d59642ac tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:06:42.034284 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fefe1937-3ed9-4b60-87d2-8bb7d59642ac tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:42.034733 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fefe1937-3ed9-4b60-87d2-8bb7d59642ac tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:42.035511 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fefe1937-3ed9-4b60-87d2-8bb7d59642ac tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:42.036001 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fefe1937-3ed9-4b60-87d2-8bb7d59642ac tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:42.162568 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fefe1937-3ed9-4b60-87d2-8bb7d59642ac tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:06:42.169851 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fefe1937-3ed9-4b60-87d2-8bb7d59642ac tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 200 len: 1453 microversion: 2.1 time: 0.147650 Apr 11 14:06:42.170413 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 533/1058] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:06:42 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:06:43.787654 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-67d06119-2f3c-4539-99cf-d2c6092f700a req-aa615d2a-8625-4850-90a5-8d8e901c8da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6026426-fd47-46b0-a22f-45ebf0500fb9", "tag": "98f3aec3-741b-4557-a19c-a2befc8b4060"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:06:43.803499 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-67d06119-2f3c-4539-99cf-d2c6092f700a req-aa615d2a-8625-4850-90a5-8d8e901c8da5 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:06:43.803499 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-67d06119-2f3c-4539-99cf-d2c6092f700a req-aa615d2a-8625-4850-90a5-8d8e901c8da5 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:06:43.813660 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-67d06119-2f3c-4539-99cf-d2c6092f700a req-aa615d2a-8625-4850-90a5-8d8e901c8da5 service nova] Creating event network-changed:98f3aec3-741b-4557-a19c-a2befc8b4060 for instance a6026426-fd47-46b0-a22f-45ebf0500fb9 on hv-cinder-83078 Apr 11 14:06:43.818761 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-67d06119-2f3c-4539-99cf-d2c6092f700a req-aa615d2a-8625-4850-90a5-8d8e901c8da5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036166 Apr 11 14:06:43.819368 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 526/1059] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 14:07:12.585540 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 14:07:12.586242 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: Mon Apr 11 14:07:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 14:08:06.339756 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a353b355-f14b-43bb-93e7-08feb2856945 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:08:06.340891 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a353b355-f14b-43bb-93e7-08feb2856945 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:08:06.347324 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a353b355-f14b-43bb-93e7-08feb2856945 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:06.347894 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a353b355-f14b-43bb-93e7-08feb2856945 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:06.348753 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a353b355-f14b-43bb-93e7-08feb2856945 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:06.349388 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a353b355-f14b-43bb-93e7-08feb2856945 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:06.376345 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a353b355-f14b-43bb-93e7-08feb2856945 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:08:06.458511 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a353b355-f14b-43bb-93e7-08feb2856945 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 204 len: 0 microversion: 2.1 time: 0.130350 Apr 11 14:08:06.463144 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 534/1060] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:08:06 2022] DELETE /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:08:06.471023 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5738aab8-53d6-4492-a084-5e8dd4078dc7 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:08:06.471809 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5738aab8-53d6-4492-a084-5e8dd4078dc7 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:08:06.472437 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-ffde38ad-1a8b-434a-a735-2336233476ec req-89c916f2-c94c-4376-8421-ad82f68706e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6026426-fd47-46b0-a22f-45ebf0500fb9", "tag": "98f3aec3-741b-4557-a19c-a2befc8b4060"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:08:06.477857 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5738aab8-53d6-4492-a084-5e8dd4078dc7 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:06.478313 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5738aab8-53d6-4492-a084-5e8dd4078dc7 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:06.479104 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5738aab8-53d6-4492-a084-5e8dd4078dc7 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:06.479545 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5738aab8-53d6-4492-a084-5e8dd4078dc7 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:06.484851 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-ffde38ad-1a8b-434a-a735-2336233476ec req-89c916f2-c94c-4376-8421-ad82f68706e8 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:06.485578 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-ffde38ad-1a8b-434a-a735-2336233476ec req-89c916f2-c94c-4376-8421-ad82f68706e8 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:06.496735 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-ffde38ad-1a8b-434a-a735-2336233476ec req-89c916f2-c94c-4376-8421-ad82f68706e8 service nova] Creating event network-changed:98f3aec3-741b-4557-a19c-a2befc8b4060 for instance a6026426-fd47-46b0-a22f-45ebf0500fb9 on hv-cinder-83078 Apr 11 14:08:06.502230 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-ffde38ad-1a8b-434a-a735-2336233476ec req-89c916f2-c94c-4376-8421-ad82f68706e8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169874 Apr 11 14:08:06.503442 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 527/1061] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:08:06.613800 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5738aab8-53d6-4492-a084-5e8dd4078dc7 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:08:06.621398 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5738aab8-53d6-4492-a084-5e8dd4078dc7 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 200 len: 1578 microversion: 2.1 time: 0.156553 Apr 11 14:08:06.621972 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 535/1062] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:08:06 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:08:07.639343 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1e5d712a-06ef-4f0c-bbf6-16a36575decb tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:08:07.640079 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1e5d712a-06ef-4f0c-bbf6-16a36575decb tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:08:07.646006 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e5d712a-06ef-4f0c-bbf6-16a36575decb tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:07.646458 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e5d712a-06ef-4f0c-bbf6-16a36575decb tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:07.647236 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e5d712a-06ef-4f0c-bbf6-16a36575decb tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:07.647697 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e5d712a-06ef-4f0c-bbf6-16a36575decb tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:07.778758 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1e5d712a-06ef-4f0c-bbf6-16a36575decb tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:08:07.786127 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1e5d712a-06ef-4f0c-bbf6-16a36575decb tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 200 len: 1578 microversion: 2.1 time: 0.151528 Apr 11 14:08:07.786687 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 528/1063] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:08:07 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:08:08.554049 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-f5b0fba3-5377-4ea5-9f8b-275696293764 req-a0f6dd80-c281-4094-b580-b197fc18f425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6026426-fd47-46b0-a22f-45ebf0500fb9", "name": "network-vif-deleted", "tag": "98f3aec3-741b-4557-a19c-a2befc8b4060"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:08:08.565236 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-f5b0fba3-5377-4ea5-9f8b-275696293764 req-a0f6dd80-c281-4094-b580-b197fc18f425 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:08.565671 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-f5b0fba3-5377-4ea5-9f8b-275696293764 req-a0f6dd80-c281-4094-b580-b197fc18f425 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:08.578353 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-f5b0fba3-5377-4ea5-9f8b-275696293764 req-a0f6dd80-c281-4094-b580-b197fc18f425 service nova] Creating event network-vif-deleted:98f3aec3-741b-4557-a19c-a2befc8b4060 for instance a6026426-fd47-46b0-a22f-45ebf0500fb9 on hv-cinder-83078 Apr 11 14:08:08.583075 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-f5b0fba3-5377-4ea5-9f8b-275696293764 req-a0f6dd80-c281-4094-b580-b197fc18f425 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032832 Apr 11 14:08:08.584263 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 536/1064] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:08:08.804120 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b2db9bdb-473e-4677-833b-d7f86906c3af tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:08:08.804737 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b2db9bdb-473e-4677-833b-d7f86906c3af tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:08:08.812004 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b2db9bdb-473e-4677-833b-d7f86906c3af tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:08.812473 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b2db9bdb-473e-4677-833b-d7f86906c3af tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:08.813266 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b2db9bdb-473e-4677-833b-d7f86906c3af tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:08.813714 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b2db9bdb-473e-4677-833b-d7f86906c3af tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:08.880091 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b2db9bdb-473e-4677-833b-d7f86906c3af tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:08:08.888167 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b2db9bdb-473e-4677-833b-d7f86906c3af tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 200 len: 1226 microversion: 2.1 time: 0.088009 Apr 11 14:08:08.898041 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 529/1065] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:08:08 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:08:09.906256 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-793f6acc-a0fb-4396-864a-8633c7466bbe tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:08:09.906961 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-793f6acc-a0fb-4396-864a-8633c7466bbe tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: a6026426-fd47-46b0-a22f-45ebf0500fb9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:08:09.913455 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-793f6acc-a0fb-4396-864a-8633c7466bbe tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:09.913968 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-793f6acc-a0fb-4396-864a-8633c7466bbe tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:09.914774 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-793f6acc-a0fb-4396-864a-8633c7466bbe tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:09.915286 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-793f6acc-a0fb-4396-864a-8633c7466bbe tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:09.928077 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-793f6acc-a0fb-4396-864a-8633c7466bbe tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] HTTP exception thrown: Instance a6026426-fd47-46b0-a22f-45ebf0500fb9 could not be found. Apr 11 14:08:09.928651 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-793f6acc-a0fb-4396-864a-8633c7466bbe tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Returning 404 to user: Instance a6026426-fd47-46b0-a22f-45ebf0500fb9 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:08:09.929514 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-793f6acc-a0fb-4396-864a-8633c7466bbe tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9" status: 404 len: 111 microversion: 2.1 time: 0.027469 Apr 11 14:08:09.930037 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 537/1066] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:08:09 2022] GET /compute/v2.1/servers/a6026426-fd47-46b0-a22f-45ebf0500fb9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:08:12.984072 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3973781b-7fdf-4a82-b184-cf2a0e2e902c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:08:12.984631 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3973781b-7fdf-4a82-b184-cf2a0e2e902c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:08:12.987189 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-0d522d95-3b32-4023-8050-1095298a08bc req-801d8425-93a1-4edc-b9ae-cc436ddec2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68774bfd-baf3-4cab-8d21-d9397b9bb4e0", "tag": "57ad0c82-296e-406b-ada6-95602f83f661"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:08:12.991455 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3973781b-7fdf-4a82-b184-cf2a0e2e902c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:12.992332 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3973781b-7fdf-4a82-b184-cf2a0e2e902c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:12.993122 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3973781b-7fdf-4a82-b184-cf2a0e2e902c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:12.993623 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3973781b-7fdf-4a82-b184-cf2a0e2e902c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:12.995404 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-0d522d95-3b32-4023-8050-1095298a08bc req-801d8425-93a1-4edc-b9ae-cc436ddec2b1 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:12.995879 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-0d522d95-3b32-4023-8050-1095298a08bc req-801d8425-93a1-4edc-b9ae-cc436ddec2b1 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:13.006626 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-0d522d95-3b32-4023-8050-1095298a08bc req-801d8425-93a1-4edc-b9ae-cc436ddec2b1 service nova] Creating event network-changed:57ad0c82-296e-406b-ada6-95602f83f661 for instance 68774bfd-baf3-4cab-8d21-d9397b9bb4e0 on hv-cinder-83078 Apr 11 14:08:13.012287 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-0d522d95-3b32-4023-8050-1095298a08bc req-801d8425-93a1-4edc-b9ae-cc436ddec2b1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028526 Apr 11 14:08:13.013450 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 538/1067] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:08:13.018319 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3973781b-7fdf-4a82-b184-cf2a0e2e902c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 14:08:13.108689 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3973781b-7fdf-4a82-b184-cf2a0e2e902c tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "DELETE /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 204 len: 0 microversion: 2.1 time: 0.127961 Apr 11 14:08:13.109930 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 530/1068] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:08:12 2022] DELETE /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 14:08:13.120249 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1126e1c9-7c00-445b-8ac4-f6d6929eca56 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:08:13.120953 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1126e1c9-7c00-445b-8ac4-f6d6929eca56 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:08:13.127205 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1126e1c9-7c00-445b-8ac4-f6d6929eca56 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:13.127676 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1126e1c9-7c00-445b-8ac4-f6d6929eca56 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:13.128673 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1126e1c9-7c00-445b-8ac4-f6d6929eca56 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:13.129107 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1126e1c9-7c00-445b-8ac4-f6d6929eca56 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:13.279297 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1126e1c9-7c00-445b-8ac4-f6d6929eca56 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:08:13.286745 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1126e1c9-7c00-445b-8ac4-f6d6929eca56 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1578 microversion: 2.1 time: 0.172209 Apr 11 14:08:13.287309 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 539/1069] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:08:13 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:08:14.305181 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4594981a-4ba1-4665-86af-02afca93559a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:08:14.306650 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4594981a-4ba1-4665-86af-02afca93559a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:08:14.312894 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4594981a-4ba1-4665-86af-02afca93559a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:14.313357 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4594981a-4ba1-4665-86af-02afca93559a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:14.314138 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4594981a-4ba1-4665-86af-02afca93559a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:14.314583 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4594981a-4ba1-4665-86af-02afca93559a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:14.450964 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4594981a-4ba1-4665-86af-02afca93559a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:08:14.458213 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4594981a-4ba1-4665-86af-02afca93559a tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1578 microversion: 2.1 time: 0.157289 Apr 11 14:08:14.458781 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 531/1070] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:08:14 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:08:14.991442 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-d6176b38-e12a-491c-b73f-2dec6c40de97 req-bcb6e3e1-0b14-48c8-9797-44df22e0b163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68774bfd-baf3-4cab-8d21-d9397b9bb4e0", "name": "network-vif-deleted", "tag": "57ad0c82-296e-406b-ada6-95602f83f661"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 14:08:15.002719 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-d6176b38-e12a-491c-b73f-2dec6c40de97 req-bcb6e3e1-0b14-48c8-9797-44df22e0b163 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:15.003169 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-d6176b38-e12a-491c-b73f-2dec6c40de97 req-bcb6e3e1-0b14-48c8-9797-44df22e0b163 service nova] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:15.016085 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-d6176b38-e12a-491c-b73f-2dec6c40de97 req-bcb6e3e1-0b14-48c8-9797-44df22e0b163 service nova] Creating event network-vif-deleted:57ad0c82-296e-406b-ada6-95602f83f661 for instance 68774bfd-baf3-4cab-8d21-d9397b9bb4e0 on hv-cinder-83078 Apr 11 14:08:15.020875 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-d6176b38-e12a-491c-b73f-2dec6c40de97 req-bcb6e3e1-0b14-48c8-9797-44df22e0b163 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033100 Apr 11 14:08:15.021474 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 540/1071] 10.222.0.67 () {64 vars in 1317 bytes} [Mon Apr 11 14:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 14:08:15.475933 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-739fd21e-a1cc-488a-9c7b-ef72a00d157d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:08:15.476509 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-739fd21e-a1cc-488a-9c7b-ef72a00d157d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:08:15.483392 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-739fd21e-a1cc-488a-9c7b-ef72a00d157d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:15.483889 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-739fd21e-a1cc-488a-9c7b-ef72a00d157d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:15.484666 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-739fd21e-a1cc-488a-9c7b-ef72a00d157d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:15.485108 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-739fd21e-a1cc-488a-9c7b-ef72a00d157d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:15.523312 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-739fd21e-a1cc-488a-9c7b-ef72a00d157d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:15.523717 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-739fd21e-a1cc-488a-9c7b-ef72a00d157d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:15.524181 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-739fd21e-a1cc-488a-9c7b-ef72a00d157d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lazy-loading 'fault' on Instance uuid 68774bfd-baf3-4cab-8d21-d9397b9bb4e0 {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 14:08:15.569715 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-739fd21e-a1cc-488a-9c7b-ef72a00d157d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64643f7804ba42f5886f949134dd4d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c040f0c3e74276bcab8dbc8e439de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 14:08:15.580435 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-739fd21e-a1cc-488a-9c7b-ef72a00d157d tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 200 len: 1231 microversion: 2.1 time: 0.108407 Apr 11 14:08:15.581107 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 532/1072] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:08:15 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 14:08:16.599242 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-80a3692d-2b73-4aa1-bd90-4a1070a5d272 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:08:16.599981 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-80a3692d-2b73-4aa1-bd90-4a1070a5d272 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 68774bfd-baf3-4cab-8d21-d9397b9bb4e0] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:08:16.606719 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80a3692d-2b73-4aa1-bd90-4a1070a5d272 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:16.607169 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80a3692d-2b73-4aa1-bd90-4a1070a5d272 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:16.607993 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80a3692d-2b73-4aa1-bd90-4a1070a5d272 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:16.608419 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80a3692d-2b73-4aa1-bd90-4a1070a5d272 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:16.621738 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-80a3692d-2b73-4aa1-bd90-4a1070a5d272 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] HTTP exception thrown: Instance 68774bfd-baf3-4cab-8d21-d9397b9bb4e0 could not be found. Apr 11 14:08:16.622332 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-80a3692d-2b73-4aa1-bd90-4a1070a5d272 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Returning 404 to user: Instance 68774bfd-baf3-4cab-8d21-d9397b9bb4e0 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:08:16.623158 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-80a3692d-2b73-4aa1-bd90-4a1070a5d272 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0" status: 404 len: 111 microversion: 2.1 time: 0.028735 Apr 11 14:08:16.623717 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 541/1073] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:08:16 2022] GET /compute/v2.1/servers/68774bfd-baf3-4cab-8d21-d9397b9bb4e0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:08:17.058956 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fc6981be-a7fa-496d-881b-cbe35bb8055f tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:08:17.059493 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fc6981be-a7fa-496d-881b-cbe35bb8055f tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:08:17.065627 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fc6981be-a7fa-496d-881b-cbe35bb8055f tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:17.066083 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fc6981be-a7fa-496d-881b-cbe35bb8055f tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:17.066851 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fc6981be-a7fa-496d-881b-cbe35bb8055f tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:17.067294 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fc6981be-a7fa-496d-881b-cbe35bb8055f tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:17.081226 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-fc6981be-a7fa-496d-881b-cbe35bb8055f tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] HTTP exception thrown: Instance 3758fe41-ad1e-4bbb-a152-9cc831519aca could not be found. Apr 11 14:08:17.081938 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fc6981be-a7fa-496d-881b-cbe35bb8055f tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Returning 404 to user: Instance 3758fe41-ad1e-4bbb-a152-9cc831519aca could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:08:17.082832 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fc6981be-a7fa-496d-881b-cbe35bb8055f tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 404 len: 111 microversion: 2.1 time: 0.027881 Apr 11 14:08:17.083394 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 533/1074] 10.222.0.67 () {58 vars in 1238 bytes} [Mon Apr 11 14:08:17 2022] DELETE /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 14:08:17.092572 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a4eab1b7-5162-41e9-ad30-75aa9a155bf4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:08:17.093192 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a4eab1b7-5162-41e9-ad30-75aa9a155bf4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] [instance: 3758fe41-ad1e-4bbb-a152-9cc831519aca] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 14:08:17.098931 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4eab1b7-5162-41e9-ad30-75aa9a155bf4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:17.099380 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4eab1b7-5162-41e9-ad30-75aa9a155bf4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:17.100170 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4eab1b7-5162-41e9-ad30-75aa9a155bf4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 14:08:17.100609 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4eab1b7-5162-41e9-ad30-75aa9a155bf4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Lock "a3c738a4-30d8-4063-acdb-1d2725038730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 14:08:17.113726 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-a4eab1b7-5162-41e9-ad30-75aa9a155bf4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] HTTP exception thrown: Instance 3758fe41-ad1e-4bbb-a152-9cc831519aca could not be found. Apr 11 14:08:17.114305 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a4eab1b7-5162-41e9-ad30-75aa9a155bf4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Returning 404 to user: Instance 3758fe41-ad1e-4bbb-a152-9cc831519aca could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 14:08:17.115117 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a4eab1b7-5162-41e9-ad30-75aa9a155bf4 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca" status: 404 len: 111 microversion: 2.1 time: 0.026519 Apr 11 14:08:17.115694 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 542/1075] 10.222.0.67 () {58 vars in 1235 bytes} [Mon Apr 11 14:08:17 2022] GET /compute/v2.1/servers/3758fe41-ad1e-4bbb-a152-9cc831519aca => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 14:08:18.396900 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a7e2a2f3-ce0e-424d-9b4c-1440d03fc719 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] Calling method '.version_select at 0x7f7306862790>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 14:08:18.419877 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a7e2a2f3-ce0e-424d-9b4c-1440d03fc719 tempest-TestVolumeBootPattern-2004717495 tempest-TestVolumeBootPattern-2004717495-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1198794692" status: 202 len: 0 microversion: 2.1 time: 0.026827 Apr 11 14:08:18.420829 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 534/1076] 10.222.0.67 () {58 vars in 1262 bytes} [Mon Apr 11 14:08:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1198794692 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 14:09:00.411484 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 14:09:00.411964 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: Mon Apr 11 14:09:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 14:09:22.625999 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 14:09:22.626704 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: Mon Apr 11 14:09:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 14:10:32.594168 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 14:10:32.594767 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: Mon Apr 11 14:10:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 14:10:40.216835 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 14:10:40.217518 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: Mon Apr 11 14:10:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 14:10:53.916730 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 14:10:53.917211 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: Mon Apr 11 14:10:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 14:10:57.886975 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 14:10:57.887406 dv-cinder-830787-2-iscsi devstack@n-api.service[116941]: Mon Apr 11 14:10:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 14:12:20.420587 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 14:12:20.421130 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: Mon Apr 11 14:12:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 14:12:42.634381 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 14:12:42.635169 dv-cinder-830787-2-iscsi devstack@n-api.service[116942]: Mon Apr 11 14:12:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!